-- Logs begin at Thu 2022-09-01 13:07:06 UTC, end at Thu 2022-09-01 14:26:17 UTC. -- Sep 01 13:55:53.229403 dv-cinder-852211-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 01 13:55:53.237930 dv-cinder-852211-7-iscsi devstack@n-api.service[106251]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 01 13:55:53.241871 dv-cinder-852211-7-iscsi devstack@n-api.service[106251]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 13:55:53 2022] *** Sep 01 13:55:53.241871 dv-cinder-852211-7-iscsi devstack@n-api.service[106251]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 13:55:53.241871 dv-cinder-852211-7-iscsi devstack@n-api.service[106251]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 13:55:53.241871 dv-cinder-852211-7-iscsi devstack@n-api.service[106251]: nodename: dv-cinder-852211-7-iscsi Sep 01 13:55:53.241871 dv-cinder-852211-7-iscsi devstack@n-api.service[106251]: machine: x86_64 Sep 01 13:55:53.241871 dv-cinder-852211-7-iscsi devstack@n-api.service[106251]: clock source: unix Sep 01 13:55:53.241871 dv-cinder-852211-7-iscsi devstack@n-api.service[106251]: pcre jit disabled Sep 01 13:55:53.241871 dv-cinder-852211-7-iscsi devstack@n-api.service[106251]: detected number of CPU cores: 4 Sep 01 13:55:53.241871 dv-cinder-852211-7-iscsi devstack@n-api.service[106251]: current working directory: / Sep 01 13:55:53.241871 dv-cinder-852211-7-iscsi devstack@n-api.service[106251]: detected binary path: /usr/bin/uwsgi-core Sep 01 13:55:53.241871 dv-cinder-852211-7-iscsi devstack@n-api.service[106251]: your processes number limit is 47680 Sep 01 13:55:53.241871 dv-cinder-852211-7-iscsi devstack@n-api.service[106251]: your memory page size is 4096 bytes Sep 01 13:55:53.241871 dv-cinder-852211-7-iscsi devstack@n-api.service[106251]: detected max file descriptor number: 2048 Sep 01 13:55:53.241871 dv-cinder-852211-7-iscsi devstack@n-api.service[106251]: lock engine: pthread robust mutexes Sep 01 13:55:53.242854 dv-cinder-852211-7-iscsi devstack@n-api.service[106251]: thunder lock: enabled Sep 01 13:55:53.242854 dv-cinder-852211-7-iscsi devstack@n-api.service[106251]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 01 13:55:53.242854 dv-cinder-852211-7-iscsi devstack@n-api.service[106251]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 13:55:53.312404 dv-cinder-852211-7-iscsi devstack@n-api.service[106251]: Python main interpreter initialized at 0x55811ec259c0 Sep 01 13:55:53.312404 dv-cinder-852211-7-iscsi devstack@n-api.service[106251]: python threads support enabled Sep 01 13:55:53.312404 dv-cinder-852211-7-iscsi devstack@n-api.service[106251]: your server socket listen backlog is limited to 100 connections Sep 01 13:55:53.312404 dv-cinder-852211-7-iscsi devstack@n-api.service[106251]: your mercy for graceful operations on workers is 90 seconds Sep 01 13:55:53.312935 dv-cinder-852211-7-iscsi devstack@n-api.service[106251]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 13:55:53.313110 dv-cinder-852211-7-iscsi devstack@n-api.service[106251]: *** Operational MODE: preforking *** Sep 01 13:55:53.313662 dv-cinder-852211-7-iscsi devstack@n-api.service[106251]: *** uWSGI is running in multiple interpreter mode *** Sep 01 13:55:53.313662 dv-cinder-852211-7-iscsi devstack@n-api.service[106251]: spawned uWSGI master process (pid: 106251) Sep 01 13:55:53.313966 dv-cinder-852211-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 01 13:55:53.315439 dv-cinder-852211-7-iscsi devstack@n-api.service[106251]: spawned uWSGI worker 1 (pid: 106252, cores: 1) Sep 01 13:55:53.315879 dv-cinder-852211-7-iscsi devstack@n-api.service[106251]: spawned uWSGI worker 2 (pid: 106253, cores: 1) Sep 01 13:55:53.316121 dv-cinder-852211-7-iscsi devstack@n-api.service[106251]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 13:55:54.056814 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 13:55:54.322692 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 13:55:55.210242 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 13:55:55.210242 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: from cryptography.utils import int_from_bytes Sep 01 13:55:55.211210 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 13:55:55.211210 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: from cryptography.utils import int_from_bytes Sep 01 13:55:55.461977 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 13:55:55.461977 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: from cryptography.utils import int_from_bytes Sep 01 13:55:55.462908 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 13:55:55.462908 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: from cryptography.utils import int_from_bytes Sep 01 13:55:57.913387 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 13:55:57.914229 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 13:55:57.914229 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 13:55:57.914654 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 13:55:57.914975 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 13:55:57.915423 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.915812 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.916226 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.916712 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.917115 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.917492 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.917877 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.918300 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.918688 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.919015 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.919385 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.919767 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852211-7-iscsi {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.920166 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.920536 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.920906 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.921282 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.921693 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.922162 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.922533 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.923109 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.923753 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.924337 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.925316 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.925490 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.925932 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.926396 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.926933 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.927391 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.927854 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.928304 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.928852 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852211-7-iscsi {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.929308 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.929757 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.930254 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.930835 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.931247 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.931638 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.932096 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.932500 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.932877 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.933265 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.933673 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.934093 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.934477 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.934838 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.935222 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.935596 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.935973 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.936390 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.936758 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.937176 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.937645 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.938074 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.938457 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.938838 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.939151 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.939462 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.940532 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.940869 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.941127 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.941500 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.941865 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.942357 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.942631 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 13:55:57.943268 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.943430 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 13:55:57.943566 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.943698 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 13:55:57.943846 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.943978 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 13:55:57.944124 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.944274 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 13:55:57.944419 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.944556 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.944693 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.944882 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.944999 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.945307 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.945440 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.945637 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.945765 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.945969 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.946216 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.946351 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.946595 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.946755 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.946925 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.947278 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.947501 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.947501 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.947772 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.947918 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852211-7-iscsi {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.948104 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.948244 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.948533 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.948694 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.948848 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.949027 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.949172 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.949444 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.949594 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.949961 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.950137 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.950303 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.950438 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.950608 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.950812 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.950959 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.951206 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.951349 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.951513 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.951687 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.951838 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.952145 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.952308 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.952502 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.952643 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.952785 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.952996 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.953148 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.953356 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.953509 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.953653 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.953867 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.954120 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852211-7-iscsi {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.954367 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.954713 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.954713 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.954964 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.955130 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.955419 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.956064 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.956303 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.956460 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.956604 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.956808 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.956961 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.957228 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.957589 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.957589 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.957975 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.958136 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.958290 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.958436 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.958589 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.958733 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.958875 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.959074 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.959220 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.959359 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.959528 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.959662 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.959945 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.960075 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.960265 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.960391 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.960570 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.960818 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.960954 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.961125 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.961272 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.961444 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.961746 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.961876 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.962095 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.962237 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.962374 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.962582 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.962780 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.962939 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.963165 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.963315 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.963494 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.963631 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.963838 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.964090 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.964229 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.964385 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.964522 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.964690 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.964950 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.965112 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.965283 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.965373 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.965588 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.965819 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.965941 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.966226 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.966323 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.966545 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.966659 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.966855 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.967072 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.967178 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.967521 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.967650 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.967911 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.968028 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.968149 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.968439 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.968585 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.968732 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.968920 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.969074 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.969347 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.969473 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.969665 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.969791 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.969998 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.970284 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.970441 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.970600 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.970722 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.971498 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.971695 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.971855 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.972116 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.972257 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.972372 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.972580 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.972718 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.973131 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.973269 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.973403 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.973518 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.973644 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.973991 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.974161 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.974306 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.974434 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.974560 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.974805 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.975174 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.975358 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.975538 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.975681 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.975959 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.976164 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.976312 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.976465 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.976605 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.976833 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.976975 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.977139 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.977297 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.977432 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.977741 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.977982 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.978185 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.978379 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.978523 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.978686 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.978858 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.978989 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.979283 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.979419 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.979588 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.979823 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.979959 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.980193 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.980333 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.980497 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.980748 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.980884 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.981110 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.981242 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.981413 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.981684 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.981836 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.982055 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.982185 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.982318 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.982621 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.982775 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.982920 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.983109 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.983241 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.983518 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.983660 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.983817 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.984064 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.984201 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.984398 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.984539 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.984703 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.984992 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.985140 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.985274 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.985469 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.985611 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.985870 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.986153 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.986288 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.986425 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.986627 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.987413 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.987574 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.987716 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.987894 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.988225 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.988463 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.988619 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.988847 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:55:57.989004 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.989190 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.989395 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.989542 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.989858 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.990105 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.990253 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.990435 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.990550 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.990835 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.990930 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.991157 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.991356 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.991469 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.991792 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.991940 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.992116 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.992273 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.992413 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.992682 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.992830 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.993024 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.993136 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.993337 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.993625 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.993728 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.993999 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.994137 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.994318 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.994585 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.994691 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.994943 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.995088 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.995254 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.995531 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.995635 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.995882 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.996023 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.996204 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.996459 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.996613 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.996847 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.996989 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.997191 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.997375 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.997520 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.997821 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.998060 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.998246 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.998414 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.998588 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.998766 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.998923 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.999076 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.999313 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.999439 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.999705 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:57.999838 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.000015 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.000223 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.000349 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.000631 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.000761 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.000952 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.001094 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.001277 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.001562 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.001694 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.001868 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.002168 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.002558 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.002708 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.002933 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.003061 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.003284 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.003493 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.003646 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.003907 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.004049 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.004198 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.004398 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.004540 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.004828 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.004978 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.005140 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.005293 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.005446 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.005751 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.005935 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.006078 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.006256 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.006412 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.006663 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.006810 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.006949 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.007183 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.007331 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.007571 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.007718 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.007905 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.008266 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.008466 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.008653 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.008865 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.008865 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.009142 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.009280 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.009414 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.009549 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.009700 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.009982 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.010127 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.010320 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.010464 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.010614 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.010904 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.011053 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.011227 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.011368 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.011522 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.011816 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.012040 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.012177 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.012335 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.012476 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.012704 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.012931 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.013071 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.013207 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.013338 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.013616 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.013815 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.013996 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.014201 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.014355 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.014556 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.014713 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.014869 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.015135 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.015289 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.015497 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.015642 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.015823 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.016064 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.016227 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.016436 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.016582 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.016757 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.016987 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.017157 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.017361 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.017495 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.017667 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.018078 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.018230 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.018387 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.018523 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.018716 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.019026 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.019147 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.019330 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.019581 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.019704 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.019920 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.020055 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.020221 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.020479 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.020634 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.020833 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.020968 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.021141 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.021379 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.021534 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.021732 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.021869 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.022079 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.022327 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.022452 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.022678 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.022816 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.023021 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.023207 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.023357 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.023651 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.023808 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.024040 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.024139 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.024277 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.024577 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.024720 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.024871 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.025043 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.025194 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.025487 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.025627 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.025881 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.026066 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.026205 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.026423 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.026570 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.026741 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.026916 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.027060 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.027303 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.027449 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.027655 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.027822 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.027974 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.028238 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.028369 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.028569 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.028814 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.029035 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.029299 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.029449 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.030059 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.030255 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.030526 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.030526 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.030866 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.030994 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.030994 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.031235 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.031374 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.031525 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.031659 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.031798 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.031936 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.032072 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.032340 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.032499 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.032659 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.032833 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.032993 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.033256 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.033979 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.034127 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.034328 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.034478 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.034721 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.034874 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.035026 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.035294 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.035448 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.035668 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.035811 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.035960 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.036235 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.036387 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.036575 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.036714 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.036943 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.037171 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.037332 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.037473 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.037620 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.037763 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.038097 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.038236 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.038405 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.038635 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.038779 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.038997 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.039201 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.039416 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.039585 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.039724 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.039893 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.040122 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.040280 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.040488 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.040634 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.040775 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.041028 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.041166 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.041395 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.041551 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.041773 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.042004 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.042123 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.042337 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.042482 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.042639 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.042900 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.043044 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.043231 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.043375 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.043538 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.043805 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.043954 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.044127 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.044317 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.044463 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.044756 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.044920 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.045075 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.045223 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.045360 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.045650 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.045803 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.045977 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.046161 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.046303 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.046593 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.046745 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.046886 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.047075 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.047228 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.047495 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.047649 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.047813 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.048020 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.048176 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.048416 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.048558 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.048726 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.048953 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.049181 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.050047 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.050205 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.050376 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.050642 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.050800 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.050987 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.051197 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.051347 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.051591 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.051744 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.051884 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.052102 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.052251 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.052531 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.052776 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.052926 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.053108 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.053402 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.053558 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.053729 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.053883 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.054115 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.054471 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.054694 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.054906 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.055044 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.055178 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.055367 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.055507 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.055658 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.055857 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.056006 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.056263 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.056418 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.056567 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.056768 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.056917 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.057153 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.057296 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.057442 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.057709 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.057857 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.058076 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.058221 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.058358 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.058654 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.058906 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.059032 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.059247 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.059400 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.059537 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.059670 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.059820 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.060072 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.060217 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.060414 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.060614 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.060794 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.061036 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.061183 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.061321 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.061473 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.061606 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.061936 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.062087 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.062282 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.062434 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.062574 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.062898 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.063062 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.063205 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.063376 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.063531 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.063842 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.064048 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.064213 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.064411 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.064627 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.064774 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.064961 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.065117 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.065318 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.065476 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.065650 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.065811 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.065986 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.066275 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.066417 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.066586 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.066740 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.066897 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.067194 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.067346 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.067501 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.067666 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.067803 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.068104 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.068254 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.068409 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.068557 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.068691 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.068996 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.069194 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.069343 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.069499 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.069653 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.069874 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.070124 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.070264 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.070452 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.070596 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.070783 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.070969 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.071171 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.071375 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.071481 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.071675 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.071869 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.071982 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.072259 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.072345 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.072572 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.072760 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.072901 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.073165 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.073312 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.073488 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.073801 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.074040 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.074189 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.074412 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.074555 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.074700 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.074999 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.075153 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.075296 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.075485 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.075645 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.075997 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.076195 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.076365 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.076504 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.076648 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.076781 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.076996 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.077166 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.077361 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.077507 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.077649 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.077967 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.078113 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.078269 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.078438 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.078581 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.078852 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.079018 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.079164 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.079307 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.079436 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.079746 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.079898 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.080054 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.080214 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.080403 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.080684 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.080956 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.081101 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.081221 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.081398 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.081651 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.081818 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.082068 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.082219 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.082377 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.082619 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.082772 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.082971 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.083121 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.083273 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.083505 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.083669 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.083878 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.084029 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.084184 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.084414 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.084586 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.084777 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.084906 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.085088 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.085341 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.085506 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.085669 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.085811 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.086046 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.086304 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.086453 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.086611 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.086797 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.086933 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.087240 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.087392 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.087535 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.087702 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.087862 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.088134 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.088275 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.088422 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.088665 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.088820 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.089028 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.089185 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.089330 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.089631 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.089787 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.090073 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.090222 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.090362 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.090557 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.090702 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.090846 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.091119 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.091284 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.091428 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.091628 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.091768 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.092030 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.092190 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.092351 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.092649 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.092794 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.092947 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.093107 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.093240 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.093545 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.093698 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.093836 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.094045 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.094215 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.094487 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.094639 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.094891 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.095085 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.095226 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.095455 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.095604 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.095767 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.096426 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.096790 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.096954 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.097110 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.097296 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.097461 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.097739 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.097934 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.098228 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.098378 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.098578 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.098710 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.098888 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.099166 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.099333 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.099479 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.099620 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.099779 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.100335 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.100485 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.100653 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.100819 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.100956 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.101245 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.101469 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.101615 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.101775 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.102012 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.102162 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.102303 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.102468 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.102743 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.102905 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.103168 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.103322 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.103469 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.103638 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.103885 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.104032 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.104178 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.104486 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.104639 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.104783 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.104927 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.105108 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.105422 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.105576 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.105720 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.105886 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.106184 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.106321 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.106472 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.106649 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.106794 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.106974 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.107245 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.107398 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.107626 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.107773 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.107916 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.108125 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.108274 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.108492 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.108649 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.108805 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.109034 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.109203 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.109461 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.109613 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.109841 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.110001 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.110177 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.110479 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.110648 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.110790 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.110925 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.111098 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.111398 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.111608 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.112340 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.112713 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.112869 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.113021 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.113350 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.113510 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.113656 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.113844 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.114022 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.114272 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.114444 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.114590 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.114802 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.115003 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.115167 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.115304 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.115442 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.115743 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.115891 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.116058 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.116200 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.116362 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.116638 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.116807 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.116981 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.117131 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.117274 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.117564 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.117716 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.117885 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.118094 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.118256 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.118501 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.118657 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.118793 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.118978 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.119120 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.119411 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.119562 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.119714 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.119972 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.120128 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.120355 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.120502 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.120664 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.120983 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.121130 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.121303 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.121457 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.121598 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.121928 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.122084 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.122258 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.122404 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.122545 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.122853 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.123027 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.123173 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.123314 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.123447 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.123739 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.123906 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.124065 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.124215 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.124391 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.124618 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.124761 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.124893 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.125106 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.125251 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.125514 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.125730 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.125877 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.126062 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.126227 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.126444 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.126608 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.126758 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.126989 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.127197 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.127377 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.127542 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.127724 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.128030 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.128170 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.128366 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.128551 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.128713 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.128989 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.129192 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.129338 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.129531 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.129679 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.129933 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.130086 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.130247 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.130558 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.130718 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.130858 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.131023 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.131182 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.131461 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.131609 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.131764 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.131929 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.132084 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.132368 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.132518 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.132830 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.132982 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.133265 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.133415 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.133581 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.133740 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.133883 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.134204 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.134372 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.134526 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.134675 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.134829 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.135081 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.135230 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.135431 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.135576 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.135747 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.136042 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.136206 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.136360 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.136506 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.136692 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.136963 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.137115 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.137343 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.137513 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.137666 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.137845 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.138025 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.138297 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.138454 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.138659 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.138803 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.138939 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.139263 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.139401 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.139551 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.139788 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.139949 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.140160 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.140444 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.140651 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.140815 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.140964 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.141107 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.141365 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.141511 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.141664 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.141808 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.141980 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.142282 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.142449 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.142595 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.143264 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.143403 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.143735 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.143887 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.144065 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.144235 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.144626 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.144769 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.144907 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.145054 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.145245 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.145465 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.145674 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.146080 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.146235 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.146404 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.146643 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.146804 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.147047 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.147193 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.147370 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.147517 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.147686 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.147963 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.148108 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.148319 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.148473 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.148632 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.148838 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.149001 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.149205 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.149347 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.149510 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.149760 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.150020 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.150182 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.150319 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.150549 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.150745 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.150881 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.151164 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.151316 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.151461 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.151848 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.152034 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.152284 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.152451 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.152683 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.152839 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.153007 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.153296 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.153443 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.153632 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.153773 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.153962 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.154251 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.154402 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.154567 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.154764 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.154909 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.155173 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.155324 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.155465 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.155710 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.155863 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.156063 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.156265 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.156477 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.156634 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.156877 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.157023 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.157160 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.157297 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.157537 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.157685 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.157847 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.158088 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.158239 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.159360 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.159712 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.159859 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.160028 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.160178 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.160321 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.160466 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.160466 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.160749 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.160869 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.160869 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.161093 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.161220 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.161347 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.161479 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.161656 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.161984 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.162137 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.162281 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.162588 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.162767 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.162928 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.163083 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.163225 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.163569 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.163737 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.163879 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.164032 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.164219 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.164416 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.164563 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.164717 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.164963 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.165107 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.165326 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.165476 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.165622 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.165871 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.166074 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.166298 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.166494 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.166820 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.166988 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.167208 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.167356 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.167531 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.167712 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.167873 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.168171 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.168325 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.168500 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.168650 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.168797 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.169098 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.169271 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.169410 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.169550 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.169712 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.170039 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.170194 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.170361 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.170535 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.170682 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.170938 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.171130 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.171290 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.171503 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.171642 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.171827 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.171963 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.172133 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.172416 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.172577 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.172715 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.172888 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.173034 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.173318 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.173483 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.173626 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.173806 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.174024 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.174315 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.174493 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.174664 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.174815 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.174967 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.175210 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.175363 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.175522 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.175663 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.175798 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.176115 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.176264 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.176420 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.176574 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.176726 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.177042 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.177183 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.177369 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.177552 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.177709 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.178002 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.178157 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.178446 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.178594 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.178734 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.179006 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.179170 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.179362 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.179509 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.179673 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.179936 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.180141 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.180285 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.180425 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.180597 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.180872 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.181038 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.181211 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.181352 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.181544 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.181813 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.182009 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.182203 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.182348 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.182525 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.182748 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.182899 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.183119 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.183266 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.183404 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.183650 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.183807 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.184015 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.184165 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.184312 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.184604 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.184753 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.184898 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.185071 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.185220 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.185478 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.185629 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.185771 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.186044 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.186192 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.186355 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.186495 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.186663 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.186966 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.187120 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.187277 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.187452 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.187599 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.187837 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.187985 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.188124 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.188351 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.188506 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.188715 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.188861 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.189007 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.189277 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.189440 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.189620 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.189760 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.190010 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.190229 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.190356 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.190562 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.190721 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.190890 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.191180 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.191380 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.191645 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.191787 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.191929 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.192106 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.192248 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.192413 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.192672 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.192829 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.193035 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.193180 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.193353 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.193578 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.193748 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.194020 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.194173 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.194316 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.194550 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.194700 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.194917 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.195077 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.195221 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.195498 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.195642 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.195843 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.195982 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.196174 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.196402 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.196546 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.196807 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.197128 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.197280 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.197440 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.197741 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.198010 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.198160 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.198322 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.198467 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.198671 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.198824 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.198994 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.199153 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.199301 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.199584 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.199737 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.199894 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.200036 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.200199 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.200484 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.200636 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.200791 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.201013 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.201166 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.201381 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.201647 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.201794 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.201981 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.202114 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.202345 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.202549 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.202702 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.202988 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.203137 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.203311 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.203476 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.203662 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.203918 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.204115 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.204303 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.204448 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.204632 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.204861 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.205007 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.205758 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.206005 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.206164 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.206328 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 13:55:58.206463 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.206829 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.207303 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.207685 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.208190 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.208588 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.208977 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.209363 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.209742 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.210191 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.210640 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.211041 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.211427 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.211879 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.212317 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.212719 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.213192 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.213650 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.214096 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.214509 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.214918 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.215587 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.215972 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.216370 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.216762 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.217153 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.217610 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.218050 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.218449 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.218859 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.219266 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.219650 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.220031 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.220430 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.221777 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.222336 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.222845 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.223238 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.223616 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.224292 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.224723 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.225360 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.225751 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.226179 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.226569 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.226942 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.227334 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.227777 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.228154 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.228549 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.228932 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.229308 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.229693 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.230122 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.230502 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.230936 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.231332 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.231704 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.232177 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.232621 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.233002 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.233383 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.233769 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.234174 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.234613 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.235004 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.235379 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.235761 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.236134 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.237385 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.238164 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.238345 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.238686 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.239107 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.239481 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.239874 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.240251 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.240633 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.241035 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.241458 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.241857 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.242393 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.242821 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.243242 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.243630 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.244273 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.244705 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.245098 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.245503 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.245926 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.246352 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.246758 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.247133 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.247527 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.247932 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.248334 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.248716 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.249094 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.249475 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.249852 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.250266 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.250654 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.251033 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.251501 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.251889 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.253007 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.253419 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.253877 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.254354 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.254838 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.255235 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.255621 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.256010 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.256397 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.256774 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.257164 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.257541 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.257942 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.258439 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.258849 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.259283 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.259661 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.260172 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.260586 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.260977 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.261367 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.261830 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.262254 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.262655 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.263071 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.263551 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.263932 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.264404 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.264911 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.265341 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.265758 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.266196 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.266575 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.266952 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.267335 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.268255 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.268752 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.269131 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.269511 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.269945 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.270313 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.270693 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.271066 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.271436 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.271888 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.272264 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.272662 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.273036 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.273517 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.274026 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.274359 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.274741 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.275122 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.275498 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.275871 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.276246 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.276642 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.277055 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.277459 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.277849 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.278284 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.278753 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.279153 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.279534 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.279921 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.280310 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.280706 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.281090 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.281496 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.281880 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.282330 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.282711 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.283094 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.284173 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.284586 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.285030 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.285429 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.285807 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.286235 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.286625 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.287018 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.287406 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.287788 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.288185 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.288566 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.289023 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.289417 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.289805 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.290228 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.290620 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.291007 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.291382 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.291768 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.292192 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.292652 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.293055 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.293438 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.293838 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.294379 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.294834 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.295252 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.295667 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.296067 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.296454 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.296834 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.297211 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:55:58.297524 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 13:55:58.366071 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: INFO dbcounter [None req-2ee4fed0-c7e2-4632-814d-d0ba3ab3f9b1 None None] Registered counter for database nova_api Sep 01 13:55:58.392342 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG oslo_db.sqlalchemy.engines [None req-2ee4fed0-c7e2-4632-814d-d0ba3ab3f9b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106252) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 13:55:58.401135 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG dbcounter [-] [106252] Writer thread running {{(pid=106252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 13:55:58.459396 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: INFO dbcounter [None req-ccfce174-e8f8-4324-b43d-3a289fe7f66e None None] Registered counter for database nova_api Sep 01 13:55:58.467155 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.context [None req-2ee4fed0-c7e2-4632-814d-d0ba3ab3f9b1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f6df5693-3372-4a09-b232-632b81efd5be(cell1) {{(pid=106252) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 13:55:58.472034 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG oslo_concurrency.lockutils [None req-2ee4fed0-c7e2-4632-814d-d0ba3ab3f9b1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:58.472639 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG oslo_concurrency.lockutils [None req-2ee4fed0-c7e2-4632-814d-d0ba3ab3f9b1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:58.474466 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG oslo_concurrency.lockutils [None req-2ee4fed0-c7e2-4632-814d-d0ba3ab3f9b1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:58.475775 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG oslo_concurrency.lockutils [None req-2ee4fed0-c7e2-4632-814d-d0ba3ab3f9b1 None None] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:58.476437 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG oslo_concurrency.lockutils [None req-2ee4fed0-c7e2-4632-814d-d0ba3ab3f9b1 None None] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:58.480032 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG oslo_concurrency.lockutils [None req-2ee4fed0-c7e2-4632-814d-d0ba3ab3f9b1 None None] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=106252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:58.482468 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG oslo_db.sqlalchemy.engines [None req-ccfce174-e8f8-4324-b43d-3a289fe7f66e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106253) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 13:55:58.482831 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: INFO dbcounter [None req-2ee4fed0-c7e2-4632-814d-d0ba3ab3f9b1 None None] Registered counter for database nova_cell0 Sep 01 13:55:58.488870 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: INFO dbcounter [None req-2ee4fed0-c7e2-4632-814d-d0ba3ab3f9b1 None None] Registered counter for database nova_cell1 Sep 01 13:55:58.491252 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG dbcounter [-] [106253] Writer thread running {{(pid=106253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 13:55:58.500850 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG oslo_db.sqlalchemy.engines [None req-2ee4fed0-c7e2-4632-814d-d0ba3ab3f9b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106252) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 13:55:58.501795 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG oslo_db.sqlalchemy.engines [None req-2ee4fed0-c7e2-4632-814d-d0ba3ab3f9b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106252) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 13:55:58.510174 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG dbcounter [-] [106252] Writer thread running {{(pid=106252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 13:55:58.512078 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG dbcounter [-] [106252] Writer thread running {{(pid=106252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 13:55:58.560191 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.context [None req-ccfce174-e8f8-4324-b43d-3a289fe7f66e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f6df5693-3372-4a09-b232-632b81efd5be(cell1) {{(pid=106253) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 13:55:58.564518 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG oslo_concurrency.lockutils [None req-ccfce174-e8f8-4324-b43d-3a289fe7f66e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:58.565231 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG oslo_concurrency.lockutils [None req-ccfce174-e8f8-4324-b43d-3a289fe7f66e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:58.567115 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG oslo_concurrency.lockutils [None req-ccfce174-e8f8-4324-b43d-3a289fe7f66e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:58.568072 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG oslo_concurrency.lockutils [None req-ccfce174-e8f8-4324-b43d-3a289fe7f66e None None] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:55:58.568802 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG oslo_concurrency.lockutils [None req-ccfce174-e8f8-4324-b43d-3a289fe7f66e None None] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:55:58.571200 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG oslo_concurrency.lockutils [None req-ccfce174-e8f8-4324-b43d-3a289fe7f66e None None] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106253) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:55:58.573466 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: INFO dbcounter [None req-ccfce174-e8f8-4324-b43d-3a289fe7f66e None None] Registered counter for database nova_cell0 Sep 01 13:55:58.580132 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: INFO dbcounter [None req-ccfce174-e8f8-4324-b43d-3a289fe7f66e None None] Registered counter for database nova_cell1 Sep 01 13:55:58.589282 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG oslo_db.sqlalchemy.engines [None req-ccfce174-e8f8-4324-b43d-3a289fe7f66e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106253) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 13:55:58.591791 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG oslo_db.sqlalchemy.engines [None req-ccfce174-e8f8-4324-b43d-3a289fe7f66e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106253) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 13:55:58.599315 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG dbcounter [-] [106253] Writer thread running {{(pid=106253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 13:55:58.668438 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: INFO dbcounter [None req-2ee4fed0-c7e2-4632-814d-d0ba3ab3f9b1 None None] Registered counter for database nova_cell0 Sep 01 13:55:58.682062 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG oslo_db.sqlalchemy.engines [None req-2ee4fed0-c7e2-4632-814d-d0ba3ab3f9b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106252) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 13:55:58.687613 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG dbcounter [-] [106252] Writer thread running {{(pid=106252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 13:55:58.749563 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG dbcounter [-] [106253] Writer thread running {{(pid=106253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 13:55:58.760921 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: INFO dbcounter [None req-ccfce174-e8f8-4324-b43d-3a289fe7f66e None None] Registered counter for database nova_cell0 Sep 01 13:55:58.768668 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG oslo_db.sqlalchemy.engines [None req-ccfce174-e8f8-4324-b43d-3a289fe7f66e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106253) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 13:55:58.774481 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG dbcounter [-] [106253] Writer thread running {{(pid=106253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 13:55:59.161362 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: WARNING keystonemiddleware.auth_token [None req-2ee4fed0-c7e2-4632-814d-d0ba3ab3f9b1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 13:55:59.168883 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: WARNING keystonemiddleware.auth_token [None req-2ee4fed0-c7e2-4632-814d-d0ba3ab3f9b1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 13:55:59.221981 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: WARNING keystonemiddleware.auth_token [None req-ccfce174-e8f8-4324-b43d-3a289fe7f66e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 13:55:59.229955 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: WARNING keystonemiddleware.auth_token [None req-ccfce174-e8f8-4324-b43d-3a289fe7f66e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 13:55:59.518348 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: WARNING keystonemiddleware.auth_token [None req-2ee4fed0-c7e2-4632-814d-d0ba3ab3f9b1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 13:55:59.524706 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: WARNING keystonemiddleware.auth_token [None req-2ee4fed0-c7e2-4632-814d-d0ba3ab3f9b1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 13:55:59.530286 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55811ec259c0 pid: 106252 (default app) Sep 01 13:55:59.532577 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-2ee4fed0-c7e2-4632-814d-d0ba3ab3f9b1 None None] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:59.534415 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-2ee4fed0-c7e2-4632-814d-d0ba3ab3f9b1 None None] 10.222.0.25 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002523 Sep 01 13:55:59.534837 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 788 bytes} [Thu Sep 1 13:55:59 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:55:59.580433 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: WARNING keystonemiddleware.auth_token [None req-ccfce174-e8f8-4324-b43d-3a289fe7f66e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 13:55:59.586747 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: WARNING keystonemiddleware.auth_token [None req-ccfce174-e8f8-4324-b43d-3a289fe7f66e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 13:55:59.592219 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55811ec259c0 pid: 106253 (default app) Sep 01 13:57:39.637788 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-2ee4fed0-c7e2-4632-814d-d0ba3ab3f9b1 None None] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:39.640810 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-2ee4fed0-c7e2-4632-814d-d0ba3ab3f9b1 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004143 Sep 01 13:57:39.642010 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 2/2] 10.222.0.25 () {54 vars in 931 bytes} [Thu Sep 1 13:57:39 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:57:39.671291 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG dbcounter [-] [106253] Writing DB stats nova_api:SELECT=3 {{(pid=106253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:57:39.673867 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG dbcounter [-] [106253] Writing DB stats nova_cell0:SELECT=3 {{(pid=106253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:57:39.675573 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG dbcounter [-] [106253] Writing DB stats nova_cell1:SELECT=3 {{(pid=106253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:57:39.677327 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG dbcounter [-] [106253] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:57:41.258416 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-8dd5d881-f6d4-4dfa-a739-bac813243aee admin admin] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:41.315519 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-8dd5d881-f6d4-4dfa-a739-bac813243aee admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.660784 Sep 01 13:57:41.316707 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 1/3] 10.222.0.25 () {60 vars in 1292 bytes} [Thu Sep 1 13:57:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:44.400497 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-2ee4fed0-c7e2-4632-814d-d0ba3ab3f9b1 None None] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:44.402929 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-2ee4fed0-c7e2-4632-814d-d0ba3ab3f9b1 None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001937 Sep 01 13:57:44.403531 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 3/4] 10.222.0.25 () {54 vars in 931 bytes} [Thu Sep 1 13:57:44 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 13:57:45.137318 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-826b13cb-a2a7-4db6-9af7-70aa2344ab1d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "name": "cirros256", "ram": 256, "id": "c1", "disk": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:57:45.247567 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-826b13cb-a2a7-4db6-9af7-70aa2344ab1d admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.834694 Sep 01 13:57:45.248142 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 2/5] 10.222.0.25 () {64 vars in 1283 bytes} [Thu Sep 1 13:57:44 2022] POST /compute/v2.1/flavors => generated 407 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 13:57:45.262897 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG dbcounter [-] [106252] Writing DB stats nova_api:SELECT=3 {{(pid=106252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:57:45.263815 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG dbcounter [-] [106252] Writing DB stats nova_cell1:SELECT=3 {{(pid=106252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:57:45.265204 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG dbcounter [-] [106252] Writing DB stats nova_cell0:SELECT=3 {{(pid=106252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:57:45.266036 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG dbcounter [-] [106252] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:57:45.483923 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-350c779d-7887-4df5-bbc7-74a67f0b6ae8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:57:45.810179 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-350c779d-7887-4df5-bbc7-74a67f0b6ae8 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.481237 Sep 01 13:57:45.810179 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 4/6] 10.222.0.25 () {64 vars in 1336 bytes} [Thu Sep 1 13:57:45 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:48.942639 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-826b13cb-a2a7-4db6-9af7-70aa2344ab1d admin admin] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:48.944323 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-826b13cb-a2a7-4db6-9af7-70aa2344ab1d admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002310 Sep 01 13:57:48.945319 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 3/7] 10.222.0.25 () {54 vars in 931 bytes} [Thu Sep 1 13:57:48 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:57:49.978921 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-aba272b6-f561-4544-82b1-2fb02432bb84 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "ds512M", "os-flavor-access:is_public": true, "swap": 0, "id": "d1", "rxtx_factor": 1.0}} {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:57:50.112416 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-aba272b6-f561-4544-82b1-2fb02432bb84 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.156224 Sep 01 13:57:50.113109 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 5/8] 10.222.0.25 () {64 vars in 1283 bytes} [Thu Sep 1 13:57:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 13:57:50.129051 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-8c3a1c86-1cc4-44a9-a96e-26e608f9efd0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:57:50.281818 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-8c3a1c86-1cc4-44a9-a96e-26e608f9efd0 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.157255 Sep 01 13:57:50.298314 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 4/9] 10.222.0.25 () {64 vars in 1336 bytes} [Thu Sep 1 13:57:50 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:57:52.920803 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-aba272b6-f561-4544-82b1-2fb02432bb84 admin admin] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:52.922018 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-aba272b6-f561-4544-82b1-2fb02432bb84 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001646 Sep 01 13:57:52.922689 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 6/10] 10.222.0.25 () {54 vars in 931 bytes} [Thu Sep 1 13:57:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:57:53.547298 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-23e63429-de85-4414-9183-ca109f080f0c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "disk": 10, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "name": "ds1G", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2"}} {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:57:53.650061 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-23e63429-de85-4414-9183-ca109f080f0c admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.717246 Sep 01 13:57:53.650964 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 5/11] 10.222.0.25 () {64 vars in 1283 bytes} [Thu Sep 1 13:57:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 13:57:53.673169 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-47e3634a-ac70-4b04-8c7f-335dc72fd543 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:57:53.816081 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-47e3634a-ac70-4b04-8c7f-335dc72fd543 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.150096 Sep 01 13:57:53.816965 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 7/12] 10.222.0.25 () {64 vars in 1336 bytes} [Thu Sep 1 13:57:53 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:57:57.316895 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-23e63429-de85-4414-9183-ca109f080f0c admin admin] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:57:57.318078 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-23e63429-de85-4414-9183-ca109f080f0c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Sep 01 13:57:57.318513 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 6/13] 10.222.0.25 () {54 vars in 931 bytes} [Thu Sep 1 13:57:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 13:57:57.975896 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-53101f17-8c90-4715-a5f2-5fc3bdcb26a6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "os-flavor-access:is_public": true, "swap": 0, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "disk": 10, "rxtx_factor": 1.0, "ram": 2048}} {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:57:58.071065 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-53101f17-8c90-4715-a5f2-5fc3bdcb26a6 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.744699 Sep 01 13:57:58.071981 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 8/14] 10.222.0.25 () {64 vars in 1283 bytes} [Thu Sep 1 13:57:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 13:57:58.089401 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-b1c02095-e0dd-48b6-82c8-99eef21d172f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:57:58.184961 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-b1c02095-e0dd-48b6-82c8-99eef21d172f admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101803 Sep 01 13:57:58.186124 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 7/15] 10.222.0.25 () {64 vars in 1336 bytes} [Thu Sep 1 13:57:58 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:58:01.443889 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-53101f17-8c90-4715-a5f2-5fc3bdcb26a6 admin admin] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:01.444800 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-53101f17-8c90-4715-a5f2-5fc3bdcb26a6 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Sep 01 13:58:01.445208 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 9/16] 10.222.0.25 () {54 vars in 931 bytes} [Thu Sep 1 13:58:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:58:02.078340 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-c1c78cc1-dd03-40cf-b542-0ef67f255407 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 4, "disk": 20, "os-flavor-access:is_public": true, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds4G", "id": "d4"}} {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:58:02.162228 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-c1c78cc1-dd03-40cf-b542-0ef67f255407 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.708845 Sep 01 13:58:02.163886 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 8/17] 10.222.0.25 () {64 vars in 1283 bytes} [Thu Sep 1 13:58:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 13:58:02.184098 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-31f000e1-aa71-4f1b-a46e-df9ad9d4b354 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:58:02.290560 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-31f000e1-aa71-4f1b-a46e-df9ad9d4b354 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113001 Sep 01 13:58:02.291345 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 10/18] 10.222.0.25 () {64 vars in 1336 bytes} [Thu Sep 1 13:58:02 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:05.642718 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-c1c78cc1-dd03-40cf-b542-0ef67f255407 admin admin] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:05.643748 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-c1c78cc1-dd03-40cf-b542-0ef67f255407 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Sep 01 13:58:05.644264 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 9/19] 10.222.0.25 () {54 vars in 931 bytes} [Thu Sep 1 13:58:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:58:06.234080 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-e04b2f21-0701-4873-beaf-fc33cc1cd59e admin admin] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:06.266985 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-e04b2f21-0701-4873-beaf-fc33cc1cd59e admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.615906 Sep 01 13:58:06.268021 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 11/20] 10.222.0.25 () {60 vars in 1292 bytes} [Thu Sep 1 13:58:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:58:08.799089 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-c1c78cc1-dd03-40cf-b542-0ef67f255407 admin admin] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:08.800119 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-c1c78cc1-dd03-40cf-b542-0ef67f255407 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Sep 01 13:58:08.800541 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 10/21] 10.222.0.25 () {54 vars in 931 bytes} [Thu Sep 1 13:58:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:58:09.378235 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-f0d2c11c-0994-4a28-a0dd-8e872a80184d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "ram": 512, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "disk": 1}} {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:58:09.480411 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-f0d2c11c-0994-4a28-a0dd-8e872a80184d admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.671515 Sep 01 13:58:09.481108 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 12/22] 10.222.0.25 () {64 vars in 1283 bytes} [Thu Sep 1 13:58:08 2022] POST /compute/v2.1/flavors => generated 402 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 13:58:09.502978 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-9f021d79-31b9-4aeb-b5f3-ae7a95ff3e3e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:58:09.607949 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-9f021d79-31b9-4aeb-b5f3-ae7a95ff3e3e admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.112316 Sep 01 13:58:09.608742 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 11/23] 10.222.0.25 () {64 vars in 1333 bytes} [Thu Sep 1 13:58:09 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:12.648483 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-f0d2c11c-0994-4a28-a0dd-8e872a80184d admin admin] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:12.649502 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-f0d2c11c-0994-4a28-a0dd-8e872a80184d admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Sep 01 13:58:12.650219 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 13/24] 10.222.0.25 () {54 vars in 931 bytes} [Thu Sep 1 13:58:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 13:58:13.453073 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-9b1ea552-9f84-4e52-ac71-7670f4b69bc5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "ram": 2048, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "m1.small", "disk": 20, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:58:13.461441 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG dbcounter [-] [106253] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=6,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:13.557718 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-9b1ea552-9f84-4e52-ac71-7670f4b69bc5 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.899330 Sep 01 13:58:13.561959 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 12/25] 10.222.0.25 () {64 vars in 1283 bytes} [Thu Sep 1 13:58:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 13:58:13.576963 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-7dc579c5-0050-4454-83c7-a213c0d53f18 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:58:13.724962 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-7dc579c5-0050-4454-83c7-a213c0d53f18 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.154303 Sep 01 13:58:13.730731 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 14/26] 10.222.0.25 () {64 vars in 1333 bytes} [Thu Sep 1 13:58:13 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:16.476706 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-9b1ea552-9f84-4e52-ac71-7670f4b69bc5 admin admin] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:16.479160 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-9b1ea552-9f84-4e52-ac71-7670f4b69bc5 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002406 Sep 01 13:58:16.480325 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 13/27] 10.222.0.25 () {54 vars in 931 bytes} [Thu Sep 1 13:58:16 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:58:17.094928 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-5b7f42e8-1371-42a5-8ec5-6d3d21c3a9a6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "vcpus": 2, "os-flavor-access:is_public": true, "ram": 4096, "swap": 0, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "rxtx_factor": 1.0}} {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:58:17.303905 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-5b7f42e8-1371-42a5-8ec5-6d3d21c3a9a6 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.815720 Sep 01 13:58:17.305349 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 15/28] 10.222.0.25 () {64 vars in 1283 bytes} [Thu Sep 1 13:58:16 2022] POST /compute/v2.1/flavors => generated 406 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 13:58:17.321597 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-f4ac1523-1c1c-428b-8d93-c257798c4fe9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:58:17.535402 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-f4ac1523-1c1c-428b-8d93-c257798c4fe9 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.220488 Sep 01 13:58:17.537250 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 14/29] 10.222.0.25 () {64 vars in 1333 bytes} [Thu Sep 1 13:58:17 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:20.563978 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-5b7f42e8-1371-42a5-8ec5-6d3d21c3a9a6 admin admin] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:20.565036 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-5b7f42e8-1371-42a5-8ec5-6d3d21c3a9a6 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Sep 01 13:58:20.575626 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 16/30] 10.222.0.25 () {54 vars in 931 bytes} [Thu Sep 1 13:58:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 13:58:21.361179 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-074e83ba-fbed-4c83-bd05-2898a2f11359 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "rxtx_factor": 1.0, "disk": 80, "name": "m1.large", "swap": 0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "os-flavor-access:is_public": true}} {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:58:21.450295 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-074e83ba-fbed-4c83-bd05-2898a2f11359 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.872919 Sep 01 13:58:21.451269 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 15/31] 10.222.0.25 () {64 vars in 1283 bytes} [Thu Sep 1 13:58:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 13:58:21.470193 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-2f79890c-272d-42e9-b66a-12bb7142d45e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:58:21.486215 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG dbcounter [-] [106252] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=106252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:21.592678 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-2f79890c-272d-42e9-b66a-12bb7142d45e admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.128667 Sep 01 13:58:21.603972 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 17/32] 10.222.0.25 () {64 vars in 1333 bytes} [Thu Sep 1 13:58:21 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:58:24.944329 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-074e83ba-fbed-4c83-bd05-2898a2f11359 admin admin] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:24.946354 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-074e83ba-fbed-4c83-bd05-2898a2f11359 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002455 Sep 01 13:58:24.947571 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 16/33] 10.222.0.25 () {54 vars in 931 bytes} [Thu Sep 1 13:58:24 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:58:25.674604 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-ca186db4-81b6-4fb8-a78c-8faef121cdfd admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "ram": 16384, "name": "m1.xlarge", "rxtx_factor": 1.0, "swap": 0, "id": "5", "disk": 160, "os-flavor-access:is_public": true}} {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:58:25.864517 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-ca186db4-81b6-4fb8-a78c-8faef121cdfd admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.906248 Sep 01 13:58:25.865184 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 18/34] 10.222.0.25 () {64 vars in 1283 bytes} [Thu Sep 1 13:58:24 2022] POST /compute/v2.1/flavors => generated 408 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 13:58:25.886735 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-ce48072b-a461-4fff-babf-2cc8641462f7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:58:26.004521 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-ce48072b-a461-4fff-babf-2cc8641462f7 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.124417 Sep 01 13:58:26.018586 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 17/35] 10.222.0.25 () {64 vars in 1333 bytes} [Thu Sep 1 13:58:25 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:58:44.967173 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-ca186db4-81b6-4fb8-a78c-8faef121cdfd admin admin] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:44.968520 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-ca186db4-81b6-4fb8-a78c-8faef121cdfd admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001872 Sep 01 13:58:44.968997 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 19/36] 10.222.0.25 () {54 vars in 931 bytes} [Thu Sep 1 13:58:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 13:58:44.981251 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG dbcounter [-] [106253] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=17,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=106253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:45.594841 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-3eeb047e-556a-4f91-b4ab-216d80efe4f6 admin admin] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:45.630115 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-3eeb047e-556a-4f91-b4ab-216d80efe4f6 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.653618 Sep 01 13:58:45.631072 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 18/37] 10.222.0.25 () {60 vars in 1292 bytes} [Thu Sep 1 13:58:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 13:58:47.128915 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-ca186db4-81b6-4fb8-a78c-8faef121cdfd admin admin] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:47.129970 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-ca186db4-81b6-4fb8-a78c-8faef121cdfd admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Sep 01 13:58:47.130402 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 20/38] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Sep 1 13:58:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:58:47.777251 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-3edd0e37-9247-4db3-98d6-2e9a63405d68 admin admin] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:47.787189 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.wsgi [None req-3edd0e37-9247-4db3-98d6-2e9a63405d68 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 01 13:58:47.793190 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-3edd0e37-9247-4db3-98d6-2e9a63405d68 admin admin] Request method failure captured: Sep 01 13:58:47.793190 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 01 13:58:47.793190 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: Accept: application/json Sep 01 13:58:47.793190 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: Accept-Encoding: gzip, deflate Sep 01 13:58:47.793190 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: Connection: keep-alive Sep 01 13:58:47.793190 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: Content-Length: 0 Sep 01 13:58:47.793190 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: Host: 10.222.0.25 Sep 01 13:58:47.793190 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: Openstack-Api-Version: compute 2.90 Sep 01 13:58:47.793190 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: Openstack-System-Scope: None Sep 01 13:58:47.793190 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: User-Agent: python-novaclient Sep 01 13:58:47.793190 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-Auth-Token: gAAAAABjELqWkzEzbI3otBs3s2OyF9lJMzw9YMJLzzJHb5UCtoYMmrR6Z21iWXDSsJ70n4hg_yU7igRfXfglhd0lB90rxSgKZl8ya8Mps0TGN64ietRbFvPs9MgfBHCx-T3LlNjfS_2VYjOJDBHSlQyRZnAamQyxKvwTjEe8ZszK8cyUq92Avko Sep 01 13:58:47.793190 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-Domain-Id: None Sep 01 13:58:47.793190 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-Domain-Name: None Sep 01 13:58:47.793190 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-Identity-Status: Confirmed Sep 01 13:58:47.793190 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-Is-Admin-Project: True Sep 01 13:58:47.793190 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 13:58:47.793190 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-Project-Domain-Id: default Sep 01 13:58:47.793190 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-Project-Domain-Name: Default Sep 01 13:58:47.793190 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-Project-Id: 1cbeb42d06b34679b1e34ad6fea416bc Sep 01 13:58:47.793190 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-Project-Name: admin Sep 01 13:58:47.793190 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-Role: admin,member,reader Sep 01 13:58:47.793190 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-Roles: admin,member,reader Sep 01 13:58:47.794996 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1cbeb42d06b34679b1e34ad6fea416bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1cbeb42d06b34679b1e34ad6fea416bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1cbeb42d06b34679b1e34ad6fea416bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1cbeb42d06b34679b1e34ad6fea416bc"}]}] Sep 01 13:58:47.794996 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-Tenant: admin Sep 01 13:58:47.794996 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-Tenant-Id: 1cbeb42d06b34679b1e34ad6fea416bc Sep 01 13:58:47.794996 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-Tenant-Name: admin Sep 01 13:58:47.794996 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-User: admin Sep 01 13:58:47.794996 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-User-Domain-Id: default Sep 01 13:58:47.794996 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-User-Domain-Name: Default Sep 01 13:58:47.794996 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-User-Id: c6e62ba856084972b01892225cf77493 Sep 01 13:58:47.794996 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-User-Name: admin Sep 01 13:58:47.794996 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: method: > Sep 01 13:58:47.794996 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: exception: Flavor 42 could not be found. Sep 01 13:58:47.794996 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: action_args: {'id': '42'} Sep 01 13:58:47.794996 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 13:58:47.794996 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:58:47.796071 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 13:58:47.796071 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 13:58:47.796071 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 13:58:47.796071 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 13:58:47.796071 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 13:58:47.796071 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 13:58:47.796071 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 13:58:47.796071 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 13:58:47.796071 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 13:58:47.796071 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:58:47.796071 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 13:58:47.796071 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 13:58:47.796071 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 01 13:58:47.796071 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi Sep 01 13:58:47.796071 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:58:47.796071 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi Sep 01 13:58:47.796071 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:58:47.796071 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:58:47.796071 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:58:47.797678 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 13:58:47.797678 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 13:58:47.797678 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 13:58:47.797678 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:58:47.797678 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 13:58:47.797678 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 13:58:47.797678 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 01 13:58:47.797678 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi Sep 01 13:58:47.797678 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:58:47.797678 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi Sep 01 13:58:47.797678 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:58:47.797678 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:58:47.797678 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:58:47.797678 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 13:58:47.797678 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 13:58:47.797678 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 01 13:58:47.797678 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi Sep 01 13:58:47.797678 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-3edd0e37-9247-4db3-98d6-2e9a63405d68 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 13:58:47.799060 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-3edd0e37-9247-4db3-98d6-2e9a63405d68 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.520655 Sep 01 13:58:47.799060 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 19/39] 10.222.0.25 () {60 vars in 1190 bytes} [Thu Sep 1 13:58:47 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 523 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 13:58:47.808061 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-02e1f891-ec89-4276-a9fe-a73dc6a5e428 admin admin] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:47.812932 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG dbcounter [-] [106252] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=106252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:47.835549 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-02e1f891-ec89-4276-a9fe-a73dc6a5e428 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.031658 Sep 01 13:58:47.836536 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 21/40] 10.222.0.25 () {60 vars in 1210 bytes} [Thu Sep 1 13:58:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 13:58:47.849171 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-27750fd6-e958-4cf1-a76b-4ecf1bd0d24a admin admin] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:47.876651 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-27750fd6-e958-4cf1-a76b-4ecf1bd0d24a admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.031449 Sep 01 13:58:47.877148 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 20/41] 10.222.0.25 () {60 vars in 1210 bytes} [Thu Sep 1 13:58:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 13:58:47.891985 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-ef681ea8-fc0a-4814-8c57-4d9a363ed145 admin admin] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:47.902627 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.wsgi [None req-ef681ea8-fc0a-4814-8c57-4d9a363ed145 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 01 13:58:47.908354 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-ef681ea8-fc0a-4814-8c57-4d9a363ed145 admin admin] Request method failure captured: Sep 01 13:58:47.908354 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 01 13:58:47.908354 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: Accept: application/json Sep 01 13:58:47.908354 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: Accept-Encoding: gzip, deflate Sep 01 13:58:47.908354 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: Connection: keep-alive Sep 01 13:58:47.908354 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: Content-Length: 0 Sep 01 13:58:47.908354 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: Host: 10.222.0.25 Sep 01 13:58:47.908354 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: Openstack-Api-Version: compute 2.90 Sep 01 13:58:47.908354 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: Openstack-System-Scope: None Sep 01 13:58:47.908354 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: User-Agent: python-novaclient Sep 01 13:58:47.908354 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-Auth-Token: gAAAAABjELqWkzEzbI3otBs3s2OyF9lJMzw9YMJLzzJHb5UCtoYMmrR6Z21iWXDSsJ70n4hg_yU7igRfXfglhd0lB90rxSgKZl8ya8Mps0TGN64ietRbFvPs9MgfBHCx-T3LlNjfS_2VYjOJDBHSlQyRZnAamQyxKvwTjEe8ZszK8cyUq92Avko Sep 01 13:58:47.908354 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-Domain-Id: None Sep 01 13:58:47.908354 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-Domain-Name: None Sep 01 13:58:47.908354 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-Identity-Status: Confirmed Sep 01 13:58:47.908354 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-Is-Admin-Project: True Sep 01 13:58:47.908354 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 13:58:47.908354 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-Project-Domain-Id: default Sep 01 13:58:47.908354 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-Project-Domain-Name: Default Sep 01 13:58:47.908354 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-Project-Id: 1cbeb42d06b34679b1e34ad6fea416bc Sep 01 13:58:47.908354 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-Project-Name: admin Sep 01 13:58:47.908354 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-Role: admin,member,reader Sep 01 13:58:47.908354 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-Roles: admin,member,reader Sep 01 13:58:47.912002 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1cbeb42d06b34679b1e34ad6fea416bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1cbeb42d06b34679b1e34ad6fea416bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1cbeb42d06b34679b1e34ad6fea416bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1cbeb42d06b34679b1e34ad6fea416bc"}]}] Sep 01 13:58:47.912002 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-Tenant: admin Sep 01 13:58:47.912002 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-Tenant-Id: 1cbeb42d06b34679b1e34ad6fea416bc Sep 01 13:58:47.912002 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-Tenant-Name: admin Sep 01 13:58:47.912002 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-User: admin Sep 01 13:58:47.912002 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-User-Domain-Id: default Sep 01 13:58:47.912002 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-User-Domain-Name: Default Sep 01 13:58:47.912002 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-User-Id: c6e62ba856084972b01892225cf77493 Sep 01 13:58:47.912002 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-User-Name: admin Sep 01 13:58:47.912002 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: method: > Sep 01 13:58:47.912002 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: exception: Flavor 42 could not be found. Sep 01 13:58:47.912002 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: action_args: {'id': '42'} Sep 01 13:58:47.912002 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 13:58:47.912002 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:58:47.912946 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 13:58:47.912946 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 13:58:47.912946 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 13:58:47.912946 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 13:58:47.912946 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 13:58:47.912946 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 13:58:47.912946 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 13:58:47.912946 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 13:58:47.912946 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 13:58:47.912946 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:58:47.912946 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 13:58:47.912946 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 13:58:47.912946 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 01 13:58:47.912946 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi Sep 01 13:58:47.912946 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:58:47.912946 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi Sep 01 13:58:47.912946 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:58:47.912946 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:58:47.912946 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:58:47.914724 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 13:58:47.914724 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 13:58:47.914724 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 13:58:47.914724 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:58:47.914724 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 13:58:47.914724 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 13:58:47.914724 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 01 13:58:47.914724 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi Sep 01 13:58:47.914724 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:58:47.914724 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi Sep 01 13:58:47.914724 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:58:47.914724 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:58:47.914724 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:58:47.914724 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 13:58:47.914724 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 13:58:47.914724 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 01 13:58:47.914724 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi Sep 01 13:58:47.914724 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-ef681ea8-fc0a-4814-8c57-4d9a363ed145 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 13:58:47.916384 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-ef681ea8-fc0a-4814-8c57-4d9a363ed145 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.025261 Sep 01 13:58:47.916384 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 22/42] 10.222.0.25 () {60 vars in 1190 bytes} [Thu Sep 1 13:58:47 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 13:58:49.020020 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-27750fd6-e958-4cf1-a76b-4ecf1bd0d24a admin admin] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:49.021093 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-27750fd6-e958-4cf1-a76b-4ecf1bd0d24a admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001560 Sep 01 13:58:49.021560 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 21/43] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Sep 1 13:58:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:58:49.697933 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-5018d96e-c229-43d3-ab57-ebb7e6b5b629 admin admin] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:49.708224 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.wsgi [None req-5018d96e-c229-43d3-ab57-ebb7e6b5b629 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 01 13:58:49.711880 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-5018d96e-c229-43d3-ab57-ebb7e6b5b629 admin admin] Request method failure captured: Sep 01 13:58:49.711880 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 01 13:58:49.711880 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: Accept: application/json Sep 01 13:58:49.711880 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: Accept-Encoding: gzip, deflate Sep 01 13:58:49.711880 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: Connection: keep-alive Sep 01 13:58:49.711880 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: Content-Length: 0 Sep 01 13:58:49.711880 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: Host: 10.222.0.25 Sep 01 13:58:49.711880 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: Openstack-Api-Version: compute 2.90 Sep 01 13:58:49.711880 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: Openstack-System-Scope: None Sep 01 13:58:49.711880 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: User-Agent: python-novaclient Sep 01 13:58:49.711880 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-Auth-Token: gAAAAABjELqYadrEfdoxQQgnY5ZTtMY1JRf_cy1LHpaWScbisPxim7VVBm4loI6H53QaC0ZfAxWsdT3qnNRIbMEHpjvdQ_sCi79pSxkXyS5rDwhxS5tMWW2VU7FK2AQmgyj-28isLgXmey1FCw5SvUwUlifgiHRjnZeGMcdBrfYgfxxYPnhjUM4 Sep 01 13:58:49.711880 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-Domain-Id: None Sep 01 13:58:49.711880 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-Domain-Name: None Sep 01 13:58:49.711880 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-Identity-Status: Confirmed Sep 01 13:58:49.711880 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-Is-Admin-Project: True Sep 01 13:58:49.711880 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 13:58:49.711880 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-Project-Domain-Id: default Sep 01 13:58:49.711880 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-Project-Domain-Name: Default Sep 01 13:58:49.711880 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-Project-Id: 1cbeb42d06b34679b1e34ad6fea416bc Sep 01 13:58:49.711880 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-Project-Name: admin Sep 01 13:58:49.711880 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-Role: admin,member,reader Sep 01 13:58:49.711880 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-Roles: admin,member,reader Sep 01 13:58:49.713590 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1cbeb42d06b34679b1e34ad6fea416bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1cbeb42d06b34679b1e34ad6fea416bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1cbeb42d06b34679b1e34ad6fea416bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1cbeb42d06b34679b1e34ad6fea416bc"}]}] Sep 01 13:58:49.713590 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-Tenant: admin Sep 01 13:58:49.713590 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-Tenant-Id: 1cbeb42d06b34679b1e34ad6fea416bc Sep 01 13:58:49.713590 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-Tenant-Name: admin Sep 01 13:58:49.713590 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-User: admin Sep 01 13:58:49.713590 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-User-Domain-Id: default Sep 01 13:58:49.713590 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-User-Domain-Name: Default Sep 01 13:58:49.713590 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-User-Id: c6e62ba856084972b01892225cf77493 Sep 01 13:58:49.713590 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-User-Name: admin Sep 01 13:58:49.713590 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: method: > Sep 01 13:58:49.713590 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: exception: Flavor 84 could not be found. Sep 01 13:58:49.713590 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: action_args: {'id': '84'} Sep 01 13:58:49.713590 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 13:58:49.713590 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:58:49.715087 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 13:58:49.715087 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 13:58:49.715087 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 13:58:49.715087 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 13:58:49.715087 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 13:58:49.715087 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 13:58:49.715087 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 13:58:49.715087 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 13:58:49.715087 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 13:58:49.715087 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:58:49.715087 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 13:58:49.715087 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 13:58:49.715087 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 01 13:58:49.715087 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi Sep 01 13:58:49.715087 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:58:49.715087 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi Sep 01 13:58:49.715087 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:58:49.715087 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:58:49.715087 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:58:49.717927 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 13:58:49.717927 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 13:58:49.717927 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 13:58:49.717927 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:58:49.717927 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 13:58:49.717927 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 13:58:49.717927 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 01 13:58:49.717927 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi Sep 01 13:58:49.717927 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:58:49.717927 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi Sep 01 13:58:49.717927 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:58:49.717927 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:58:49.717927 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:58:49.717927 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 13:58:49.717927 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 13:58:49.717927 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 01 13:58:49.717927 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi Sep 01 13:58:49.717927 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-5018d96e-c229-43d3-ab57-ebb7e6b5b629 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 13:58:49.720293 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-5018d96e-c229-43d3-ab57-ebb7e6b5b629 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.548626 Sep 01 13:58:49.720293 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 23/44] 10.222.0.25 () {60 vars in 1190 bytes} [Thu Sep 1 13:58:49 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 551 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 13:58:49.728827 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-345db44b-3b8e-46be-9c0e-e1b31adc2961 admin admin] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:49.746266 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-345db44b-3b8e-46be-9c0e-e1b31adc2961 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021500 Sep 01 13:58:49.749224 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 22/45] 10.222.0.25 () {60 vars in 1210 bytes} [Thu Sep 1 13:58:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 13:58:49.762293 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-f6422d74-1dfe-4080-ad74-687b1e6a7a50 admin admin] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:49.793174 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-f6422d74-1dfe-4080-ad74-687b1e6a7a50 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.036724 Sep 01 13:58:49.794190 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 24/46] 10.222.0.25 () {60 vars in 1210 bytes} [Thu Sep 1 13:58:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:58:49.807436 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-e419a7c2-4435-4745-aee6-54a050814d04 admin admin] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:49.813564 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.wsgi [None req-e419a7c2-4435-4745-aee6-54a050814d04 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 01 13:58:49.815257 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-e419a7c2-4435-4745-aee6-54a050814d04 admin admin] Request method failure captured: Sep 01 13:58:49.815257 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 01 13:58:49.815257 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: Accept: application/json Sep 01 13:58:49.815257 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: Accept-Encoding: gzip, deflate Sep 01 13:58:49.815257 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: Connection: keep-alive Sep 01 13:58:49.815257 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: Content-Length: 0 Sep 01 13:58:49.815257 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: Host: 10.222.0.25 Sep 01 13:58:49.815257 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: Openstack-Api-Version: compute 2.90 Sep 01 13:58:49.815257 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: Openstack-System-Scope: None Sep 01 13:58:49.815257 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: User-Agent: python-novaclient Sep 01 13:58:49.815257 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-Auth-Token: gAAAAABjELqYadrEfdoxQQgnY5ZTtMY1JRf_cy1LHpaWScbisPxim7VVBm4loI6H53QaC0ZfAxWsdT3qnNRIbMEHpjvdQ_sCi79pSxkXyS5rDwhxS5tMWW2VU7FK2AQmgyj-28isLgXmey1FCw5SvUwUlifgiHRjnZeGMcdBrfYgfxxYPnhjUM4 Sep 01 13:58:49.815257 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-Domain-Id: None Sep 01 13:58:49.815257 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-Domain-Name: None Sep 01 13:58:49.815257 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-Identity-Status: Confirmed Sep 01 13:58:49.815257 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-Is-Admin-Project: True Sep 01 13:58:49.815257 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 13:58:49.815257 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-Project-Domain-Id: default Sep 01 13:58:49.815257 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-Project-Domain-Name: Default Sep 01 13:58:49.815257 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-Project-Id: 1cbeb42d06b34679b1e34ad6fea416bc Sep 01 13:58:49.815257 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-Project-Name: admin Sep 01 13:58:49.815257 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-Role: admin,member,reader Sep 01 13:58:49.815257 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-Roles: admin,member,reader Sep 01 13:58:49.817790 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1cbeb42d06b34679b1e34ad6fea416bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1cbeb42d06b34679b1e34ad6fea416bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1cbeb42d06b34679b1e34ad6fea416bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1cbeb42d06b34679b1e34ad6fea416bc"}]}] Sep 01 13:58:49.817790 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-Tenant: admin Sep 01 13:58:49.817790 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-Tenant-Id: 1cbeb42d06b34679b1e34ad6fea416bc Sep 01 13:58:49.817790 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-Tenant-Name: admin Sep 01 13:58:49.817790 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-User: admin Sep 01 13:58:49.817790 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-User-Domain-Id: default Sep 01 13:58:49.817790 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-User-Domain-Name: Default Sep 01 13:58:49.817790 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-User-Id: c6e62ba856084972b01892225cf77493 Sep 01 13:58:49.817790 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-User-Name: admin Sep 01 13:58:49.817790 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: method: > Sep 01 13:58:49.817790 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: exception: Flavor 84 could not be found. Sep 01 13:58:49.817790 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: action_args: {'id': '84'} Sep 01 13:58:49.817790 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 13:58:49.817790 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:58:49.819578 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 13:58:49.819578 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 13:58:49.819578 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 13:58:49.819578 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 13:58:49.819578 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 13:58:49.819578 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 13:58:49.819578 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 13:58:49.819578 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 13:58:49.819578 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 13:58:49.819578 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:58:49.819578 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 13:58:49.819578 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 13:58:49.819578 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 01 13:58:49.819578 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi Sep 01 13:58:49.819578 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:58:49.819578 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi Sep 01 13:58:49.819578 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:58:49.819578 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:58:49.819578 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:58:49.821601 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 13:58:49.821601 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 13:58:49.821601 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 13:58:49.821601 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:58:49.821601 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 13:58:49.821601 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 13:58:49.821601 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 01 13:58:49.821601 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi Sep 01 13:58:49.821601 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:58:49.821601 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi Sep 01 13:58:49.821601 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:58:49.821601 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:58:49.821601 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:58:49.821601 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 13:58:49.821601 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 13:58:49.821601 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 01 13:58:49.821601 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi Sep 01 13:58:49.821601 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-e419a7c2-4435-4745-aee6-54a050814d04 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 13:58:49.823802 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-e419a7c2-4435-4745-aee6-54a050814d04 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013369 Sep 01 13:58:49.823802 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 23/47] 10.222.0.25 () {60 vars in 1190 bytes} [Thu Sep 1 13:58:49 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 13:58:50.925161 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-f6422d74-1dfe-4080-ad74-687b1e6a7a50 admin admin] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:50.926202 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-f6422d74-1dfe-4080-ad74-687b1e6a7a50 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Sep 01 13:58:50.926618 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 25/48] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Sep 1 13:58:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:58:51.596555 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-0bcbaa0f-c59b-461e-8590-08bb80a18a07 admin admin] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:51.605257 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.wsgi [None req-0bcbaa0f-c59b-461e-8590-08bb80a18a07 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 01 13:58:51.606954 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-0bcbaa0f-c59b-461e-8590-08bb80a18a07 admin admin] Request method failure captured: Sep 01 13:58:51.606954 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 01 13:58:51.606954 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: Accept: application/json Sep 01 13:58:51.606954 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: Accept-Encoding: gzip, deflate Sep 01 13:58:51.606954 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: Connection: keep-alive Sep 01 13:58:51.606954 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: Content-Length: 0 Sep 01 13:58:51.606954 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: Host: 10.222.0.25 Sep 01 13:58:51.606954 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: Openstack-Api-Version: compute 2.90 Sep 01 13:58:51.606954 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: Openstack-System-Scope: None Sep 01 13:58:51.606954 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: User-Agent: python-novaclient Sep 01 13:58:51.606954 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-Auth-Token: gAAAAABjELqajco9Q13ly48j9M5Juy3MFKBKVReMtCL8yKaogtF_M9rdKUioYktLieHeQGsTDx3KHEyFfiRUs6mzXR36WjL-onXhDRJYoozAMgsGzQS6JMR3Ic7JDOCQFsVj8Lfc30dppjkJIimghzW37Z7X4MX23pYIK9NNfXZmtEeaiFGJYSE Sep 01 13:58:51.606954 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-Domain-Id: None Sep 01 13:58:51.606954 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-Domain-Name: None Sep 01 13:58:51.606954 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-Identity-Status: Confirmed Sep 01 13:58:51.606954 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-Is-Admin-Project: True Sep 01 13:58:51.606954 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 13:58:51.606954 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-Project-Domain-Id: default Sep 01 13:58:51.606954 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-Project-Domain-Name: Default Sep 01 13:58:51.606954 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-Project-Id: 1cbeb42d06b34679b1e34ad6fea416bc Sep 01 13:58:51.606954 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-Project-Name: admin Sep 01 13:58:51.606954 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-Role: admin,member,reader Sep 01 13:58:51.606954 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-Roles: admin,member,reader Sep 01 13:58:51.609322 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1cbeb42d06b34679b1e34ad6fea416bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1cbeb42d06b34679b1e34ad6fea416bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1cbeb42d06b34679b1e34ad6fea416bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1cbeb42d06b34679b1e34ad6fea416bc"}]}] Sep 01 13:58:51.609322 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-Tenant: admin Sep 01 13:58:51.609322 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-Tenant-Id: 1cbeb42d06b34679b1e34ad6fea416bc Sep 01 13:58:51.609322 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-Tenant-Name: admin Sep 01 13:58:51.609322 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-User: admin Sep 01 13:58:51.609322 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-User-Domain-Id: default Sep 01 13:58:51.609322 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-User-Domain-Name: Default Sep 01 13:58:51.609322 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-User-Id: c6e62ba856084972b01892225cf77493 Sep 01 13:58:51.609322 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: X-User-Name: admin Sep 01 13:58:51.609322 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: method: > Sep 01 13:58:51.609322 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: exception: Flavor 451 could not be found. Sep 01 13:58:51.609322 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: action_args: {'id': '451'} Sep 01 13:58:51.609322 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 13:58:51.609322 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:58:51.610792 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 13:58:51.610792 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 13:58:51.610792 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 13:58:51.610792 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 13:58:51.610792 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 13:58:51.610792 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 13:58:51.610792 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 13:58:51.610792 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 13:58:51.610792 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 13:58:51.610792 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:58:51.610792 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 13:58:51.610792 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 13:58:51.610792 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 01 13:58:51.610792 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi Sep 01 13:58:51.610792 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:58:51.610792 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi Sep 01 13:58:51.610792 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:58:51.610792 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:58:51.610792 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:58:51.612805 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 13:58:51.612805 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 13:58:51.612805 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 13:58:51.612805 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:58:51.612805 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 13:58:51.612805 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 13:58:51.612805 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 01 13:58:51.612805 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi Sep 01 13:58:51.612805 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:58:51.612805 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi Sep 01 13:58:51.612805 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:58:51.612805 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:58:51.612805 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:58:51.612805 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 13:58:51.612805 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 13:58:51.612805 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 01 13:58:51.612805 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: ERROR nova.api.openstack.wsgi Sep 01 13:58:51.612805 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-0bcbaa0f-c59b-461e-8590-08bb80a18a07 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106253) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 13:58:51.614911 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-0bcbaa0f-c59b-461e-8590-08bb80a18a07 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.526755 Sep 01 13:58:51.614911 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 24/49] 10.222.0.25 () {60 vars in 1193 bytes} [Thu Sep 1 13:58:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 528 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 13:58:51.622831 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-c53aca43-41a1-4512-861f-2d16c5137a92 admin admin] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:51.639948 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-c53aca43-41a1-4512-861f-2d16c5137a92 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020786 Sep 01 13:58:51.640615 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 26/50] 10.222.0.25 () {60 vars in 1210 bytes} [Thu Sep 1 13:58:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:58:51.652289 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-d3f608c4-5abc-442e-90a3-86f54fde2b3f admin admin] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:51.668529 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-d3f608c4-5abc-442e-90a3-86f54fde2b3f admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020723 Sep 01 13:58:51.669293 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 25/51] 10.222.0.25 () {60 vars in 1210 bytes} [Thu Sep 1 13:58:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 13:58:51.679731 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-25134cee-5f55-479b-ae02-b6c3a2e609aa admin admin] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:51.685832 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.wsgi [None req-25134cee-5f55-479b-ae02-b6c3a2e609aa admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 01 13:58:51.687406 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-25134cee-5f55-479b-ae02-b6c3a2e609aa admin admin] Request method failure captured: Sep 01 13:58:51.687406 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 01 13:58:51.687406 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: Accept: application/json Sep 01 13:58:51.687406 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: Accept-Encoding: gzip, deflate Sep 01 13:58:51.687406 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: Connection: keep-alive Sep 01 13:58:51.687406 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: Content-Length: 0 Sep 01 13:58:51.687406 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: Host: 10.222.0.25 Sep 01 13:58:51.687406 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: Openstack-Api-Version: compute 2.90 Sep 01 13:58:51.687406 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: Openstack-System-Scope: None Sep 01 13:58:51.687406 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: User-Agent: python-novaclient Sep 01 13:58:51.687406 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-Auth-Token: gAAAAABjELqajco9Q13ly48j9M5Juy3MFKBKVReMtCL8yKaogtF_M9rdKUioYktLieHeQGsTDx3KHEyFfiRUs6mzXR36WjL-onXhDRJYoozAMgsGzQS6JMR3Ic7JDOCQFsVj8Lfc30dppjkJIimghzW37Z7X4MX23pYIK9NNfXZmtEeaiFGJYSE Sep 01 13:58:51.687406 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-Domain-Id: None Sep 01 13:58:51.687406 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-Domain-Name: None Sep 01 13:58:51.687406 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-Identity-Status: Confirmed Sep 01 13:58:51.687406 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-Is-Admin-Project: True Sep 01 13:58:51.687406 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 13:58:51.687406 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-Project-Domain-Id: default Sep 01 13:58:51.687406 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-Project-Domain-Name: Default Sep 01 13:58:51.687406 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-Project-Id: 1cbeb42d06b34679b1e34ad6fea416bc Sep 01 13:58:51.687406 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-Project-Name: admin Sep 01 13:58:51.687406 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-Role: admin,member,reader Sep 01 13:58:51.687406 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-Roles: admin,member,reader Sep 01 13:58:51.694487 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1cbeb42d06b34679b1e34ad6fea416bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1cbeb42d06b34679b1e34ad6fea416bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1cbeb42d06b34679b1e34ad6fea416bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1cbeb42d06b34679b1e34ad6fea416bc"}]}] Sep 01 13:58:51.694487 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-Tenant: admin Sep 01 13:58:51.694487 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-Tenant-Id: 1cbeb42d06b34679b1e34ad6fea416bc Sep 01 13:58:51.694487 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-Tenant-Name: admin Sep 01 13:58:51.694487 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-User: admin Sep 01 13:58:51.694487 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-User-Domain-Id: default Sep 01 13:58:51.694487 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-User-Domain-Name: Default Sep 01 13:58:51.694487 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-User-Id: c6e62ba856084972b01892225cf77493 Sep 01 13:58:51.694487 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: X-User-Name: admin Sep 01 13:58:51.694487 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: method: > Sep 01 13:58:51.694487 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: exception: Flavor 451 could not be found. Sep 01 13:58:51.694487 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: action_args: {'id': '451'} Sep 01 13:58:51.694487 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 13:58:51.694487 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:58:51.696435 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 13:58:51.696435 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 13:58:51.696435 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 13:58:51.696435 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 13:58:51.696435 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 13:58:51.696435 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 13:58:51.696435 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 13:58:51.696435 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 13:58:51.696435 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 13:58:51.696435 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:58:51.696435 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 13:58:51.696435 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 13:58:51.696435 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 01 13:58:51.696435 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi Sep 01 13:58:51.696435 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:58:51.696435 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi Sep 01 13:58:51.696435 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:58:51.696435 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:58:51.696435 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:58:51.697711 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 13:58:51.697711 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 13:58:51.697711 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 13:58:51.697711 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:58:51.697711 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 13:58:51.697711 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 13:58:51.697711 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 01 13:58:51.697711 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi Sep 01 13:58:51.697711 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:58:51.697711 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi Sep 01 13:58:51.697711 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:58:51.697711 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:58:51.697711 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:58:51.697711 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 13:58:51.697711 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 13:58:51.697711 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 01 13:58:51.697711 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: ERROR nova.api.openstack.wsgi Sep 01 13:58:51.697711 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-25134cee-5f55-479b-ae02-b6c3a2e609aa admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 13:58:51.698862 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-25134cee-5f55-479b-ae02-b6c3a2e609aa admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013211 Sep 01 13:58:51.698862 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 27/52] 10.222.0.25 () {60 vars in 1193 bytes} [Thu Sep 1 13:58:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 13:58:52.810431 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-d3f608c4-5abc-442e-90a3-86f54fde2b3f admin admin] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:52.811785 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-d3f608c4-5abc-442e-90a3-86f54fde2b3f admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002086 Sep 01 13:58:52.812386 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 26/53] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Sep 1 13:58:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:58:53.457008 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-8ce598df-4c79-41ef-80b1-6cac427e0693 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:58:53.571484 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-8ce598df-4c79-41ef-80b1-6cac427e0693 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.612093 Sep 01 13:58:53.571990 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 28/54] 10.222.0.25 () {64 vars in 1235 bytes} [Thu Sep 1 13:58:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 13:58:54.733932 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-d3f608c4-5abc-442e-90a3-86f54fde2b3f admin admin] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:54.735459 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-d3f608c4-5abc-442e-90a3-86f54fde2b3f admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002187 Sep 01 13:58:54.736023 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 27/55] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Sep 1 13:58:54 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:58:55.466492 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-eae502de-1423-41ef-b3d0-1dc67a888acd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:58:55.551250 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-eae502de-1423-41ef-b3d0-1dc67a888acd admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.643798 Sep 01 13:58:55.551965 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 29/56] 10.222.0.25 () {64 vars in 1235 bytes} [Thu Sep 1 13:58:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 13:58:56.666480 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-d3f608c4-5abc-442e-90a3-86f54fde2b3f admin admin] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:56.667453 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-d3f608c4-5abc-442e-90a3-86f54fde2b3f admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001555 Sep 01 13:58:56.667868 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 28/57] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Sep 1 13:58:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:58:57.396656 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-be53fc38-0671-4bde-b107-048d927727af admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:58:57.553827 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-be53fc38-0671-4bde-b107-048d927727af admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.736137 Sep 01 13:58:57.555222 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 30/58] 10.222.0.25 () {64 vars in 1235 bytes} [Thu Sep 1 13:58:56 2022] POST /compute/v2.1/flavors => generated 407 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 13:58:58.673078 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-d3f608c4-5abc-442e-90a3-86f54fde2b3f admin admin] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:58.674046 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-d3f608c4-5abc-442e-90a3-86f54fde2b3f admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Sep 01 13:58:58.674456 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 29/59] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Sep 1 13:58:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:58:59.368651 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-ce19afba-8608-4c82-a93d-37287c901e70 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:58:59.468805 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-ce19afba-8608-4c82-a93d-37287c901e70 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.651186 Sep 01 13:58:59.469367 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 31/60] 10.222.0.25 () {64 vars in 1235 bytes} [Thu Sep 1 13:58:58 2022] POST /compute/v2.1/flavors => generated 409 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 13:59:01.201302 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-d3f608c4-5abc-442e-90a3-86f54fde2b3f admin admin] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:01.202360 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-d3f608c4-5abc-442e-90a3-86f54fde2b3f admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Sep 01 13:59:01.202784 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 30/61] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Sep 1 13:59:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:59:01.908019 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-d1b5a9de-1422-4d4a-bb79-b6f5b2640ecc admin admin] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:59:01.931361 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-d1b5a9de-1422-4d4a-bb79-b6f5b2640ecc admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.574769 Sep 01 13:59:01.931938 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 32/62] 10.222.0.25 () {60 vars in 1202 bytes} [Thu Sep 1 13:59:01 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:00:03.808165 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-d3f608c4-5abc-442e-90a3-86f54fde2b3f admin admin] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:03.809283 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-d3f608c4-5abc-442e-90a3-86f54fde2b3f admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001560 Sep 01 14:00:03.809774 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 31/63] 10.222.0.25 () {54 vars in 931 bytes} [Thu Sep 1 14:00:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:00:03.819429 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG dbcounter [-] [106252] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:04.360301 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-e6e621b2-e55c-421b-8db6-30f84b74c8ca admin admin] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:04.383132 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-e6e621b2-e55c-421b-8db6-30f84b74c8ca admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.565056 Sep 01 14:00:04.383710 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 33/64] 10.222.0.25 () {60 vars in 1292 bytes} [Thu Sep 1 14:00:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:00:04.406340 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG dbcounter [-] [106253] Writing DB stats nova_api:SELECT=14 {{(pid=106253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:04.410366 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-da60077e-3eec-48f4-b36f-77dd37e65e00 admin admin] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:04.418656 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-da60077e-3eec-48f4-b36f-77dd37e65e00 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013695 Sep 01 14:00:04.419218 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 32/65] 10.222.0.25 () {60 vars in 1283 bytes} [Thu Sep 1 14:00:04 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:00:04.433682 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-9afda76a-abf0-4309-9e26-caa9d35cf2b5 admin admin] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:04.443328 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-9afda76a-abf0-4309-9e26-caa9d35cf2b5 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013611 Sep 01 14:00:04.443878 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 34/66] 10.222.0.25 () {60 vars in 1286 bytes} [Thu Sep 1 14:00:04 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:00:04.460384 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-ec427d25-8801-46d1-898a-2c394fe7fcba admin admin] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:04.475021 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-ec427d25-8801-46d1-898a-2c394fe7fcba admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.021565 Sep 01 14:00:04.475993 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 33/67] 10.222.0.25 () {60 vars in 1286 bytes} [Thu Sep 1 14:00:04 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:00:04.489918 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-97a163de-0f29-42ee-a3ba-252046711866 admin admin] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:04.498206 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-97a163de-0f29-42ee-a3ba-252046711866 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012881 Sep 01 14:00:04.498777 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 35/68] 10.222.0.25 () {60 vars in 1283 bytes} [Thu Sep 1 14:00:04 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:32.579944 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-ec427d25-8801-46d1-898a-2c394fe7fcba admin admin] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:32.581399 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-ec427d25-8801-46d1-898a-2c394fe7fcba admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002025 Sep 01 14:03:32.582002 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 34/69] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Sep 1 14:03:32 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:03:32.726136 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG dbcounter [-] [106252] Writing DB stats nova_api:SELECT=6 {{(pid=106252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:03:32.891622 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-6426d888-0e4e-441f-b955-9041a96581f4 admin admin] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:32.896315 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG oslo_concurrency.lockutils [None req-6426d888-0e4e-441f-b955-9041a96581f4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:32.896801 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG oslo_concurrency.lockutils [None req-6426d888-0e4e-441f-b955-9041a96581f4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:32.897233 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG oslo_concurrency.lockutils [None req-6426d888-0e4e-441f-b955-9041a96581f4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:32.897990 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG oslo_concurrency.lockutils [None req-6426d888-0e4e-441f-b955-9041a96581f4 admin admin] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:32.898467 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG oslo_concurrency.lockutils [None req-6426d888-0e4e-441f-b955-9041a96581f4 admin admin] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:32.898938 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG oslo_concurrency.lockutils [None req-6426d888-0e4e-441f-b955-9041a96581f4 admin admin] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:32.939551 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-6426d888-0e4e-441f-b955-9041a96581f4 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.215057 Sep 01 14:03:32.940135 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 36/70] 10.222.0.25 () {60 vars in 1193 bytes} [Thu Sep 1 14:03:32 2022] GET /compute/v2.1/os-services => generated 791 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 14:03:33.830576 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-ec427d25-8801-46d1-898a-2c394fe7fcba admin admin] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:33.831588 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-ec427d25-8801-46d1-898a-2c394fe7fcba admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Sep 01 14:03:33.831987 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 35/71] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Sep 1 14:03:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:03:34.032954 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-a1472684-8b3c-40ec-9434-80f8afb35958 admin admin] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:34.037204 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG oslo_concurrency.lockutils [None req-a1472684-8b3c-40ec-9434-80f8afb35958 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:34.037679 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG oslo_concurrency.lockutils [None req-a1472684-8b3c-40ec-9434-80f8afb35958 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:34.038129 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG oslo_concurrency.lockutils [None req-a1472684-8b3c-40ec-9434-80f8afb35958 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:34.038849 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG oslo_concurrency.lockutils [None req-a1472684-8b3c-40ec-9434-80f8afb35958 admin admin] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:34.039357 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG oslo_concurrency.lockutils [None req-a1472684-8b3c-40ec-9434-80f8afb35958 admin admin] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:34.039744 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG oslo_concurrency.lockutils [None req-a1472684-8b3c-40ec-9434-80f8afb35958 admin admin] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:34.060007 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-a1472684-8b3c-40ec-9434-80f8afb35958 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.085080 Sep 01 14:03:34.060593 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 37/72] 10.222.0.25 () {60 vars in 1193 bytes} [Thu Sep 1 14:03:33 2022] GET /compute/v2.1/os-services => generated 791 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 14:03:45.368732 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-ec427d25-8801-46d1-898a-2c394fe7fcba admin admin] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:45.369978 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-ec427d25-8801-46d1-898a-2c394fe7fcba admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001660 Sep 01 14:03:45.370504 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 36/73] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Sep 1 14:03:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:03:45.524437 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG dbcounter [-] [106252] Writing DB stats nova_cell0:SELECT=4 {{(pid=106252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:03:45.525181 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG dbcounter [-] [106252] Writing DB stats nova_cell1:SELECT=4 {{(pid=106252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:03:45.525792 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG dbcounter [-] [106252] Writing DB stats nova_api:SELECT=8 {{(pid=106252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:03:45.582728 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-3b964fe8-c4f1-4f6a-b940-daf38d53acb8 admin admin] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:45.586581 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG oslo_concurrency.lockutils [None req-3b964fe8-c4f1-4f6a-b940-daf38d53acb8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:45.591384 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG oslo_concurrency.lockutils [None req-3b964fe8-c4f1-4f6a-b940-daf38d53acb8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:45.591384 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG oslo_concurrency.lockutils [None req-3b964fe8-c4f1-4f6a-b940-daf38d53acb8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:45.591384 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG oslo_concurrency.lockutils [None req-3b964fe8-c4f1-4f6a-b940-daf38d53acb8 admin admin] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:45.591384 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG oslo_concurrency.lockutils [None req-3b964fe8-c4f1-4f6a-b940-daf38d53acb8 admin admin] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:45.591952 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG oslo_concurrency.lockutils [None req-3b964fe8-c4f1-4f6a-b940-daf38d53acb8 admin admin] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:45.617089 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-3b964fe8-c4f1-4f6a-b940-daf38d53acb8 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.097863 Sep 01 14:03:45.617956 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 38/74] 10.222.0.25 () {60 vars in 1193 bytes} [Thu Sep 1 14:03:45 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:03:46.513274 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: DEBUG nova.api.openstack.wsgi [None req-ec427d25-8801-46d1-898a-2c394fe7fcba admin admin] Calling method '>' {{(pid=106253) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:46.514323 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: INFO nova.api.openstack.requestlog [None req-ec427d25-8801-46d1-898a-2c394fe7fcba admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Sep 01 14:03:46.514736 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: [pid: 106253|app: 0|req: 37/75] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Sep 1 14:03:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:03:46.727798 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG nova.api.openstack.wsgi [None req-7d9642ba-e156-474d-bc92-a7e447a1246d admin admin] Calling method '>' {{(pid=106252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:46.731837 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG oslo_concurrency.lockutils [None req-7d9642ba-e156-474d-bc92-a7e447a1246d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:46.732406 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG oslo_concurrency.lockutils [None req-7d9642ba-e156-474d-bc92-a7e447a1246d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:46.732825 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG oslo_concurrency.lockutils [None req-7d9642ba-e156-474d-bc92-a7e447a1246d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:46.733667 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG oslo_concurrency.lockutils [None req-7d9642ba-e156-474d-bc92-a7e447a1246d admin admin] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:46.734206 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG oslo_concurrency.lockutils [None req-7d9642ba-e156-474d-bc92-a7e447a1246d admin admin] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:46.734666 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: DEBUG oslo_concurrency.lockutils [None req-7d9642ba-e156-474d-bc92-a7e447a1246d admin admin] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:46.760460 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: INFO nova.api.openstack.requestlog [None req-7d9642ba-e156-474d-bc92-a7e447a1246d admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.093805 Sep 01 14:03:46.761045 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: [pid: 106252|app: 0|req: 39/76] 10.222.0.25 () {60 vars in 1193 bytes} [Thu Sep 1 14:03:46 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:04:46.937469 dv-cinder-852211-7-iscsi devstack@n-api.service[106251]: Thu Sep 1 14:04:46 2022 - graceful shutdown triggered... Sep 01 14:04:46.942171 dv-cinder-852211-7-iscsi devstack@n-api.service[106253]: Gracefully killing worker 2 (pid: 106253)... Sep 01 14:04:46.937500 dv-cinder-852211-7-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 01 14:04:46.943700 dv-cinder-852211-7-iscsi devstack@n-api.service[106252]: Gracefully killing worker 1 (pid: 106252)... Sep 01 14:04:47.939469 dv-cinder-852211-7-iscsi devstack@n-api.service[106251]: worker 1 buried after 1 seconds Sep 01 14:04:47.939469 dv-cinder-852211-7-iscsi devstack@n-api.service[106251]: worker 2 buried after 1 seconds Sep 01 14:04:47.939469 dv-cinder-852211-7-iscsi devstack@n-api.service[106251]: goodbye to uWSGI. Sep 01 14:04:47.941268 dv-cinder-852211-7-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 01 14:04:47.941968 dv-cinder-852211-7-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 01 14:04:47.945304 dv-cinder-852211-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 01 14:04:47.962239 dv-cinder-852211-7-iscsi devstack@n-api.service[121323]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 01 14:04:47.965454 dv-cinder-852211-7-iscsi devstack@n-api.service[121323]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 14:04:47 2022] *** Sep 01 14:04:47.965454 dv-cinder-852211-7-iscsi devstack@n-api.service[121323]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 14:04:47.965454 dv-cinder-852211-7-iscsi devstack@n-api.service[121323]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 14:04:47.965454 dv-cinder-852211-7-iscsi devstack@n-api.service[121323]: nodename: dv-cinder-852211-7-iscsi Sep 01 14:04:47.965454 dv-cinder-852211-7-iscsi devstack@n-api.service[121323]: machine: x86_64 Sep 01 14:04:47.965454 dv-cinder-852211-7-iscsi devstack@n-api.service[121323]: clock source: unix Sep 01 14:04:47.965454 dv-cinder-852211-7-iscsi devstack@n-api.service[121323]: pcre jit disabled Sep 01 14:04:47.965454 dv-cinder-852211-7-iscsi devstack@n-api.service[121323]: detected number of CPU cores: 4 Sep 01 14:04:47.965454 dv-cinder-852211-7-iscsi devstack@n-api.service[121323]: current working directory: / Sep 01 14:04:47.965454 dv-cinder-852211-7-iscsi devstack@n-api.service[121323]: detected binary path: /usr/bin/uwsgi-core Sep 01 14:04:47.966233 dv-cinder-852211-7-iscsi devstack@n-api.service[121323]: your processes number limit is 47680 Sep 01 14:04:47.966233 dv-cinder-852211-7-iscsi devstack@n-api.service[121323]: your memory page size is 4096 bytes Sep 01 14:04:47.966233 dv-cinder-852211-7-iscsi devstack@n-api.service[121323]: detected max file descriptor number: 2048 Sep 01 14:04:47.966233 dv-cinder-852211-7-iscsi devstack@n-api.service[121323]: lock engine: pthread robust mutexes Sep 01 14:04:47.966233 dv-cinder-852211-7-iscsi devstack@n-api.service[121323]: thunder lock: enabled Sep 01 14:04:47.966233 dv-cinder-852211-7-iscsi devstack@n-api.service[121323]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 01 14:04:47.966233 dv-cinder-852211-7-iscsi devstack@n-api.service[121323]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 14:04:48.010742 dv-cinder-852211-7-iscsi devstack@n-api.service[121323]: Python main interpreter initialized at 0x56202d5149c0 Sep 01 14:04:48.010742 dv-cinder-852211-7-iscsi devstack@n-api.service[121323]: python threads support enabled Sep 01 14:04:48.010742 dv-cinder-852211-7-iscsi devstack@n-api.service[121323]: your server socket listen backlog is limited to 100 connections Sep 01 14:04:48.010742 dv-cinder-852211-7-iscsi devstack@n-api.service[121323]: your mercy for graceful operations on workers is 90 seconds Sep 01 14:04:48.011424 dv-cinder-852211-7-iscsi devstack@n-api.service[121323]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 14:04:48.011424 dv-cinder-852211-7-iscsi devstack@n-api.service[121323]: *** Operational MODE: preforking *** Sep 01 14:04:48.011833 dv-cinder-852211-7-iscsi devstack@n-api.service[121323]: *** uWSGI is running in multiple interpreter mode *** Sep 01 14:04:48.011833 dv-cinder-852211-7-iscsi devstack@n-api.service[121323]: spawned uWSGI master process (pid: 121323) Sep 01 14:04:48.012087 dv-cinder-852211-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 01 14:04:48.013278 dv-cinder-852211-7-iscsi devstack@n-api.service[121323]: spawned uWSGI worker 1 (pid: 121339, cores: 1) Sep 01 14:04:48.013739 dv-cinder-852211-7-iscsi devstack@n-api.service[121323]: spawned uWSGI worker 2 (pid: 121340, cores: 1) Sep 01 14:04:48.013997 dv-cinder-852211-7-iscsi devstack@n-api.service[121323]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 14:04:48.817759 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 14:04:48.819656 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 14:04:50.604379 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 14:04:50.604379 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: from cryptography.utils import int_from_bytes Sep 01 14:04:50.604897 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 14:04:50.604897 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: from cryptography.utils import int_from_bytes Sep 01 14:04:50.860836 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 14:04:50.860836 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: from cryptography.utils import int_from_bytes Sep 01 14:04:50.861808 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 14:04:50.861808 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: from cryptography.utils import int_from_bytes Sep 01 14:04:53.330455 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 14:04:53.331234 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 14:04:53.331336 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 14:04:53.331628 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 14:04:53.331885 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 14:04:53.332307 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.332659 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.333014 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.333374 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.333735 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.334103 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.334460 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.334834 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.335210 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.335500 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.335828 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.336268 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852211-7-iscsi {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.336825 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.337183 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.337510 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.337866 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.338247 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.338606 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.338946 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.339505 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.340018 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.340339 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.340796 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.341172 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.341524 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.341842 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.346594 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.346594 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.346594 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.346594 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.346594 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852211-7-iscsi {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.346594 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.346594 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.346594 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.347734 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.347734 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.347734 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.347734 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.347734 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.347734 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.348481 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.348481 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.348742 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.348868 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.349155 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.349476 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.349785 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.350135 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.350448 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.350759 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.351018 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.351333 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.351738 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.352054 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.352418 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.352692 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.352976 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.353321 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.353646 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.354004 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.354351 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.354659 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.355013 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.355360 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.355693 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.356034 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.356367 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.356737 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.357085 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.357439 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.357864 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.358218 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.358665 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.358951 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.359271 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.359630 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.359948 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.360261 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.360588 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.360916 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.361229 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.361542 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.361855 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.362213 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.362557 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.362866 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.363127 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.363431 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.363742 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.364067 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.364385 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.364697 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.365009 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.365313 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.365624 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.365956 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.366272 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.366586 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.366957 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.367251 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.367595 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.367910 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.368215 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.368525 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.368906 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.369233 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.369549 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.369864 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.370204 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.370512 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.370840 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.371154 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.371742 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.372086 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.372390 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.372699 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.373088 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.373433 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.373792 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.374177 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.375117 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.375457 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.375828 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.376180 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.376525 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.376853 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.377204 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.377529 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.377864 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.378232 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.378583 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.378918 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.379268 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.379626 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.379972 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.380352 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.380636 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.380987 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:53.381352 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.381708 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.382109 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.382463 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.382826 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.383189 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.383535 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.383879 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.384226 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.384562 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.384880 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.385199 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.385517 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.385842 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.386202 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.386538 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.386865 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.387183 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.387505 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.387825 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.388150 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.388485 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.388822 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.389138 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.389516 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.389987 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.390343 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.390723 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.391143 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.391449 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.391792 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.392134 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.392543 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.392893 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.393235 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.393588 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.393958 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.394314 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.394636 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.394955 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.395275 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.395592 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.395907 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.396257 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.396602 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.396910 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.397234 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.397552 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.398022 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.398249 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.398590 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.398936 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.399276 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.399629 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.399970 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.400309 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.400644 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.401017 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.401391 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.401711 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.402148 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.402488 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.402808 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.403128 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.403441 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.403751 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.404079 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.404395 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.404703 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.405038 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.405353 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.405688 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.406037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.406348 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.406661 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.406987 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.407309 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.407621 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.407940 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.408254 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.408593 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.408909 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.409228 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.409572 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.409933 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.410249 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.410582 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.410909 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.411235 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.411542 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.411857 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.412167 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.412479 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.412788 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.413102 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.413410 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.413749 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.414114 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.414475 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.414763 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.415136 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.415477 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.415816 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.416152 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.416490 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.416881 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.417238 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.417542 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.417887 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.418281 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.418678 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.419016 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.419403 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.419753 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.420101 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.420425 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.420744 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.421075 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.421981 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.422309 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.422628 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.422964 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.423283 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.423612 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.423924 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.424251 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.424620 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.424986 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.425335 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.425695 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.426062 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.426409 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.426748 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.427090 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.427432 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.427774 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.428097 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.428414 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.428737 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.429053 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.429671 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.430016 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.430347 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.430662 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.430979 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.431325 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.431658 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.432598 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.432598 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.432598 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.433004 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.433206 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.433522 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.433831 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.434171 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.434495 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.434816 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.435139 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.435453 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.435759 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.436073 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.436382 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.436697 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.437123 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.437584 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.437778 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.438120 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.438445 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.438770 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.439080 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.439388 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.439720 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.440030 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.440338 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.440650 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.440961 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.441347 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.441662 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.442083 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.442344 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.442719 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.443060 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.443390 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.443703 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.444021 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.444352 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.444680 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.444993 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.445315 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.445632 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.445972 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.446291 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.446619 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.446980 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.447246 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.447562 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.447878 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.448196 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.448513 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.449113 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.449451 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.450260 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.450420 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.450704 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.451035 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.451366 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.451703 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.452014 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.452326 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.453171 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.453483 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.453795 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.454163 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.454473 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.454843 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.455159 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.455509 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.455838 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.456152 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.456458 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.456766 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.457092 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.457401 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.457720 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.458273 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.458445 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.458763 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.459079 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.459389 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.459697 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.460051 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.460363 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.460713 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.461040 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.461384 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.461691 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.462026 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.462353 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.462661 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.462968 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.463280 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.463588 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.463899 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.464204 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.464526 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.464837 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.465148 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.465459 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.465763 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.466103 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.466411 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.466734 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.467048 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.468087 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.468087 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.468087 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.469035 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.469302 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.469431 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.469728 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.470116 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.470428 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.470782 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.471154 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.471351 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.471666 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.471970 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.472308 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.472626 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.472934 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.473265 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.473580 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.473884 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.474200 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.474517 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.474843 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.475164 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.475472 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.475785 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.476143 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.476510 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.476839 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.477166 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.477508 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.477846 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.478180 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.478531 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.478875 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.479242 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.479561 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.479899 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.480235 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.480542 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.481018 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.481392 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.481564 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.481876 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.482217 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.482550 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.482864 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.483180 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.483502 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.484026 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.484468 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.484785 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.485106 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.485416 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.485732 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.486090 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.486412 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.486731 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.487085 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.487436 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.487806 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.488119 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.488440 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.488759 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.489071 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.489391 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.489708 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.490063 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.490379 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.490694 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.491017 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.491338 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.491669 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.491970 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.492284 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.492620 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.492980 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.493319 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.493636 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.493975 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.494289 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.494614 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.494918 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.495451 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.495724 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.496084 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.496420 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.496761 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.497079 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.497399 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.497723 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.498087 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.498519 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.498865 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.499258 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.499636 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.499931 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.500252 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.500567 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.500928 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.501242 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.501581 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.501947 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.502293 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.502637 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.502967 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.503406 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.503732 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.504039 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.504468 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.504832 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.505096 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.505426 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.505762 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.506103 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.506411 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.506736 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.507052 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.507380 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.507709 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.508032 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.508353 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.508687 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.509015 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.509383 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.509745 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.510204 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.510648 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.510974 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.511294 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.511626 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.511965 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.512277 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.512588 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.512903 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.513214 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.513588 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.514015 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.514319 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.514676 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.515545 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.515861 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.516256 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.516764 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.517109 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.517417 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.517749 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.518105 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.518437 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.518767 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.519091 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.519449 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.519808 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.520123 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.520437 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.520753 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.521106 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.521418 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.521747 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.522109 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.522449 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.522764 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.523105 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.523437 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.523763 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.524089 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.524422 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.524733 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.525042 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.525357 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.525733 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.526001 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.526315 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.526626 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.526931 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.527241 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.527549 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.527880 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.528187 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.528511 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.528828 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.529135 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.529446 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.529752 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.530136 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.531303 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.531660 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.532013 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.532370 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.532691 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.533014 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.533336 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.533656 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.534003 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.534328 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.534649 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.534969 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.535291 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.535611 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.535938 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.536524 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.536859 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.537178 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.537497 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.537814 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.538239 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.538559 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.538877 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.539194 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.539510 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.539825 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.540162 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.540495 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.540830 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.541174 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.541507 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.541825 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.542172 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.542493 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.542870 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.543185 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.543495 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.543815 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.544141 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.544460 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.544776 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.545100 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.545421 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.545740 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.546087 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.546434 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.546753 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.547125 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.547403 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.547749 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.548076 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.548397 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.548715 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.549036 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.549619 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.549963 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.550309 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.550644 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.550977 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.551300 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.551646 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.551962 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.552273 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.552585 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.552902 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.553241 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.553526 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.553851 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.554223 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.554535 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.554863 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.555223 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.555850 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.557683 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.557683 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.557683 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.557683 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.557683 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.558406 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.558406 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.558660 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.558822 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.559164 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.559503 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.559822 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.560132 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.560450 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.560764 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.561074 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.561390 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.561699 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.562158 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.562425 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.562912 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.563243 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.563686 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.563866 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.564168 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.564480 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.564791 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.565118 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.565424 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.565739 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.566071 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.566394 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.566703 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.567076 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.567594 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.567936 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.568251 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.568561 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.568892 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.569213 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.569537 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.569855 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.570284 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.570676 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.571020 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.571646 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.572424 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.572424 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.572772 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.572970 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.573311 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.573597 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.574000 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.574264 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.574582 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.575160 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.575481 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.575797 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.576115 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.576429 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.576742 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.577053 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.577923 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.578235 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.578809 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.579251 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.579572 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.579891 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.580221 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.580581 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.580910 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.581233 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.581553 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.581874 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.582217 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.582533 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.582843 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.583154 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.583475 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.583808 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.584199 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.584537 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.585006 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.585355 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.585707 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.586080 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.586397 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.586725 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.587054 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.587373 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.587700 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.588016 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.588350 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.588700 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.589032 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.589361 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.589670 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.589999 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.590312 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.590624 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.590947 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.591265 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.591571 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.591877 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.592192 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.592500 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.592810 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.593833 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.594203 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.595010 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.595010 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.595422 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.595744 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.596115 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.596433 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.596940 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.597119 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.597487 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.597778 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.598170 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.598503 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.598878 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.599235 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.599574 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.599902 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.600237 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.600557 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.600883 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.601199 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.601525 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.601850 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.602209 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.602526 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.602889 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.603231 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.603553 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.604014 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.604237 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.605350 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.605350 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.605350 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.605735 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.605876 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.606203 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.606492 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.606823 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.607142 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.607460 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.607794 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.608111 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.608426 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.608774 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.609097 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.609406 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.609725 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.610065 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.610416 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.610761 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.611120 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.611486 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.611842 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.612160 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.612496 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.612829 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.613187 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.613515 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.613863 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.614224 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.614540 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.614865 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.615173 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:53.615441 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 14:04:53.680860 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO dbcounter [None req-fd195e42-acc9-4a9d-b9bb-45fa3fb8c566 None None] Registered counter for database nova_api Sep 01 14:04:53.704238 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_db.sqlalchemy.engines [None req-fd195e42-acc9-4a9d-b9bb-45fa3fb8c566 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121339) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 14:04:53.711661 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writer thread running {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 14:04:53.777572 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.context [None req-fd195e42-acc9-4a9d-b9bb-45fa3fb8c566 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f6df5693-3372-4a09-b232-632b81efd5be(cell1) {{(pid=121339) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 14:04:53.782725 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fd195e42-acc9-4a9d-b9bb-45fa3fb8c566 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:53.783349 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fd195e42-acc9-4a9d-b9bb-45fa3fb8c566 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:53.785279 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fd195e42-acc9-4a9d-b9bb-45fa3fb8c566 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:53.786170 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fd195e42-acc9-4a9d-b9bb-45fa3fb8c566 None None] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:53.786658 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fd195e42-acc9-4a9d-b9bb-45fa3fb8c566 None None] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:53.788841 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fd195e42-acc9-4a9d-b9bb-45fa3fb8c566 None None] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:53.791137 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO dbcounter [None req-fd195e42-acc9-4a9d-b9bb-45fa3fb8c566 None None] Registered counter for database nova_cell0 Sep 01 14:04:53.795734 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO dbcounter [None req-fd195e42-acc9-4a9d-b9bb-45fa3fb8c566 None None] Registered counter for database nova_cell1 Sep 01 14:04:53.804876 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_db.sqlalchemy.engines [None req-fd195e42-acc9-4a9d-b9bb-45fa3fb8c566 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121339) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 14:04:53.807293 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_db.sqlalchemy.engines [None req-fd195e42-acc9-4a9d-b9bb-45fa3fb8c566 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121339) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 14:04:53.814919 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writer thread running {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 14:04:53.816640 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writer thread running {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 14:04:53.975215 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO dbcounter [None req-fd195e42-acc9-4a9d-b9bb-45fa3fb8c566 None None] Registered counter for database nova_cell0 Sep 01 14:04:53.984715 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_db.sqlalchemy.engines [None req-fd195e42-acc9-4a9d-b9bb-45fa3fb8c566 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121339) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 14:04:53.991095 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writer thread running {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 14:04:54.332440 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: WARNING keystonemiddleware.auth_token [None req-fd195e42-acc9-4a9d-b9bb-45fa3fb8c566 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 14:04:54.341429 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: WARNING keystonemiddleware.auth_token [None req-fd195e42-acc9-4a9d-b9bb-45fa3fb8c566 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 14:04:54.729072 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: WARNING keystonemiddleware.auth_token [None req-fd195e42-acc9-4a9d-b9bb-45fa3fb8c566 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 14:04:54.738386 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: WARNING keystonemiddleware.auth_token [None req-fd195e42-acc9-4a9d-b9bb-45fa3fb8c566 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 14:04:54.746178 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56202d5149c0 pid: 121339 (default app) Sep 01 14:04:55.304065 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 14:04:55.304736 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 14:04:55.304938 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 14:04:55.305239 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 14:04:55.305494 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 14:04:55.305887 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.306457 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.306637 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.306865 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.307200 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.307513 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.307839 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.308167 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.308495 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.308757 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.309072 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.309395 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852211-7-iscsi {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.309719 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.310058 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.310369 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.310690 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.310993 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.311318 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.311622 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.313126 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.313441 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.313750 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.314089 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.314439 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.314757 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.315063 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.315384 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.315690 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.316018 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.316372 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.316780 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852211-7-iscsi {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.317098 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.317415 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.317722 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.318183 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.318498 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.318810 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.319134 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.319467 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.319776 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.320124 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.320447 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.320769 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.321093 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.321406 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.321717 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.322058 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.322381 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.322688 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.322991 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.323242 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.323596 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.323922 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.324274 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.324606 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.325109 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.325381 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.325685 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.326035 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.326346 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.326655 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.326958 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.327264 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.327626 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.327936 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.328725 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.329027 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.329351 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.329663 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.330014 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.330331 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.330653 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.331068 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.331308 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.331634 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.331963 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.332283 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.332594 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.332915 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.333241 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.333544 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.333851 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.334188 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.334509 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.334903 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.335151 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.335403 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.335705 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.336008 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.336330 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.336637 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.336943 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.337247 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.337547 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.337850 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.338189 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.338498 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.338804 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.339101 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.339403 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.339707 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.340154 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.340294 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.340599 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.340934 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.341254 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.341556 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.342666 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.342666 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.342666 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.343125 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.343125 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.343393 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.343719 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.344088 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.344305 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.344626 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.344949 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.345230 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.345552 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.345848 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.346179 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.346498 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.346804 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.347103 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.347408 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.347707 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.348006 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.348305 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.348618 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.348914 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.349193 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.349512 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.349826 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.350164 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.350493 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.350800 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.351120 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 14:04:55.351457 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.351791 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.352133 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.352446 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.352781 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.353110 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.353425 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.353733 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.354113 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.354423 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.354710 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.355019 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.355313 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.355626 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.355939 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.356267 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.356581 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.356892 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.357206 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.357513 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.357824 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.358183 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.358496 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.358840 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.359188 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.359544 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.359929 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.360270 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.360597 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.360909 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.361218 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.361543 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.361873 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.362238 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.362555 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.362871 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.363183 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.363512 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.363825 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.364137 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.364454 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.364764 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.365075 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.365435 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.365753 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.366106 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.366425 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.366737 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.367053 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.367370 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.367680 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.367989 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.368292 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.368597 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.368902 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.369210 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.369516 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.369838 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.370208 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.370513 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.370851 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.371156 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.371462 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.371773 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.372084 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.372392 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.372701 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.373010 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.373309 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.373635 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.373980 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.374800 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.375373 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.375716 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.376018 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.376339 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.376793 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.376968 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.377278 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.377639 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.377963 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.378285 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.378597 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.379747 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.379747 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.379747 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.380299 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.380299 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.380723 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.380918 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.381244 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.381419 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.381712 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.382046 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.382356 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.382658 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.382965 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.383267 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.383570 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.383981 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.384217 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.384491 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.384794 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.385092 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.385395 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.385744 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.386076 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.386431 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.386759 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.387078 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.387400 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.387713 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.388027 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.388337 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.388646 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.388956 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.389263 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.389580 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.389892 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.390795 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.391122 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.391456 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.391766 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.392084 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.392390 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.392702 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.393045 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.393382 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.393698 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.394043 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.394363 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.394676 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.394986 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.395297 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.395607 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.395917 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.396237 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.396546 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.396863 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.397171 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.397500 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.397808 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.398155 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.398458 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.398770 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.399101 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.399438 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.399743 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.400054 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.400373 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.400683 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.400991 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.401297 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.401610 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.401971 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.402242 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.402558 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.402866 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.403154 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.403464 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.403775 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.404085 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.404390 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.404691 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.404998 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.405325 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.406407 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.406609 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.406812 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.407119 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.407417 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.407740 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.408051 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.408351 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.408656 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.408957 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.409309 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.409617 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.409940 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.410262 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.410582 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.410889 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.411204 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.411510 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.411828 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.412155 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.412474 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.412777 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.413087 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.413396 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.413704 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.414056 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.414391 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.414695 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.415015 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.415321 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.415625 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.415934 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.416244 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.416842 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.417176 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.417498 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.417818 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.418194 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.418517 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.418854 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.419187 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.419502 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.419852 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.420133 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.420442 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.420749 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.421059 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.422010 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.422324 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.422643 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.423002 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.423229 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.423537 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.423837 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.424148 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.424486 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.424770 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.425101 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.425388 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.425721 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.426069 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.426373 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.426677 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.426978 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.427326 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.427630 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.427971 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.428301 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.428645 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.428952 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.429256 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.429582 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.429888 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.430217 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.430524 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.430840 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.431144 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.431443 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.431756 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.432087 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.432491 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.432655 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.433083 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.433257 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.433559 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.433881 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.434230 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.434515 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.434820 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.435126 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.435432 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.435736 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.436061 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.436376 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.436689 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.437519 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.437826 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.438157 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.438464 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.439364 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.439364 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.439364 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.439718 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.439982 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.440284 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.440594 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.440897 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.441201 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.441507 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.441834 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.442183 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.442487 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.442798 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.443103 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.443426 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.443733 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.444022 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.444326 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.444632 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.444936 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.445239 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.445543 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.445873 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.446210 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.446515 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.446821 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.447125 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.447477 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.447806 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.448180 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.448484 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.448802 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.449124 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.449438 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.449748 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.450349 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.450655 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.450971 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.451284 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.451595 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.451896 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.452200 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.453441 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.453767 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.454122 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.454453 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.454789 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.455120 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.455428 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.455743 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.456057 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.456366 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.456678 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.456990 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.457301 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.457610 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.457947 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.458261 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.458565 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.458869 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.459178 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.459486 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.459789 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.460153 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.460463 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.460767 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.461075 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.461377 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.461686 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.462013 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.462466 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.462780 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.463089 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.463394 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.463703 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.464012 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.464326 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.464649 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.464955 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.465386 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.465698 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.466033 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.466344 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.466646 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.466950 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.467257 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.467581 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.467883 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.468738 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.469039 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.469356 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.469663 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.470003 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.470432 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.470765 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.471067 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.471486 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.471796 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.472104 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.472426 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.472750 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.473075 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.473382 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.473700 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.474043 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.474371 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.474698 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.475011 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.475321 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.475624 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.475949 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.476273 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.476586 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.476906 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.477334 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.477657 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.477989 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.478317 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.478643 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.478946 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.479250 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.479556 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.479923 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.480212 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.480536 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.480844 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.481148 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.481458 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.481767 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.482090 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.482396 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.482720 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.483022 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.483344 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.483687 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.484569 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.484899 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.485222 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.485965 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.486159 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.486294 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.486600 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.487073 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.487243 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.487780 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.487925 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.488177 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.488507 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.488817 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.489152 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.489479 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.489797 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.490216 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.490548 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.490896 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.491307 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.491513 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.491816 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.492119 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.492421 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.492727 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.493095 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.493333 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.493633 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.493983 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.494415 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.494672 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.494915 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.495215 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.495519 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.495818 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.496208 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.496590 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.496925 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.497253 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.497651 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.497880 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.498221 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.498537 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.498853 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.499219 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.499522 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.499987 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.500295 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.500606 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.501072 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.501276 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.501838 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.502194 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.502506 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.502817 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.503127 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.503441 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.503752 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.504062 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.504372 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.504692 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.505002 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.505338 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.505662 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.506014 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.506356 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.506676 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.506987 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.507298 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.507612 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.507977 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.508290 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.508596 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.508909 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.509221 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.509533 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.509842 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.510178 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.510489 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.510799 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.511108 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.511417 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.511728 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.512038 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.512367 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.512706 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.513027 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.513336 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.513646 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.513984 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.514563 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.514895 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.515263 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.515591 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.515923 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.516232 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.516563 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.516893 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.517195 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.517499 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.517809 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.518142 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.518615 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.518950 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.519322 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.519654 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.519937 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.520192 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.520780 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.521142 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.521459 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.521789 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.522168 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.522490 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.522800 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.523128 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.523437 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.523744 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.524063 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.524378 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.524684 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.525005 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.525316 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.525622 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.525956 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.526258 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.526562 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.526890 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.527194 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.527499 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.527806 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.528116 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.528422 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.528724 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.529030 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.529332 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.529645 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.529972 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.530281 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.531118 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.531432 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.531739 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.532104 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.532403 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.532735 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.533041 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.533345 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.533666 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.534001 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.534327 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.534641 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.534953 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.535317 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.535632 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.536228 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.536565 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.536901 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.537239 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.537568 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.537873 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.538202 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.538505 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.538831 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.539199 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.539454 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.539764 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.540074 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.540380 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.540690 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.540996 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.541305 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.541612 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.541941 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.542306 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.542555 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.542861 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.543166 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.543484 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.543840 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.544162 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.544478 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.544792 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.545107 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.545427 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.545736 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.546071 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.547023 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.547323 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.547662 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.547970 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.548272 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.548710 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.549023 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.549340 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.549660 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.549993 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.550320 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.550645 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.550957 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.551275 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.551585 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.551916 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.552258 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.552587 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.552911 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.553218 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.553522 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.553827 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.554287 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.554554 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.554862 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.555163 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.555482 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.555784 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.556084 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.556387 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.556690 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.556992 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.557300 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.557601 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.557956 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.558233 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.558534 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.558835 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.559136 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.559442 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.559742 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.560043 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.560353 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.560658 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.560964 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.561306 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.561641 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.562625 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.563011 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.563328 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.563650 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.563958 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.564283 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.564605 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.564928 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.565239 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.565585 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.565918 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.566308 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.566615 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.566928 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.567235 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.567545 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.567883 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.568209 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.568515 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.568844 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.569162 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.569485 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.569799 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.570137 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.570471 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.570847 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.571279 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.571623 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.571941 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.572249 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.572577 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.572877 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.573190 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.573507 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.573822 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.574187 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.574518 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.575080 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.575413 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.575771 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.576103 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.576419 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.576771 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.577100 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.577441 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.578402 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.578708 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 14:04:55.578959 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 14:04:55.738824 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO dbcounter [None req-39c20b8d-0272-4679-b356-ed3c9982414b None None] Registered counter for database nova_api Sep 01 14:04:55.761429 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_db.sqlalchemy.engines [None req-39c20b8d-0272-4679-b356-ed3c9982414b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121340) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 14:04:55.769446 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writer thread running {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 14:04:55.832332 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.context [None req-39c20b8d-0272-4679-b356-ed3c9982414b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f6df5693-3372-4a09-b232-632b81efd5be(cell1) {{(pid=121340) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 14:04:55.836786 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-39c20b8d-0272-4679-b356-ed3c9982414b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:55.837274 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-39c20b8d-0272-4679-b356-ed3c9982414b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:55.838920 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-39c20b8d-0272-4679-b356-ed3c9982414b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:55.839844 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-39c20b8d-0272-4679-b356-ed3c9982414b None None] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:55.840115 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-39c20b8d-0272-4679-b356-ed3c9982414b None None] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:55.842176 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-39c20b8d-0272-4679-b356-ed3c9982414b None None] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:55.844337 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO dbcounter [None req-39c20b8d-0272-4679-b356-ed3c9982414b None None] Registered counter for database nova_cell0 Sep 01 14:04:55.849068 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO dbcounter [None req-39c20b8d-0272-4679-b356-ed3c9982414b None None] Registered counter for database nova_cell1 Sep 01 14:04:55.858109 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_db.sqlalchemy.engines [None req-39c20b8d-0272-4679-b356-ed3c9982414b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121340) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 14:04:55.860433 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_db.sqlalchemy.engines [None req-39c20b8d-0272-4679-b356-ed3c9982414b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121340) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 14:04:55.870495 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writer thread running {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 14:04:55.872977 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writer thread running {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 14:04:56.053091 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO dbcounter [None req-39c20b8d-0272-4679-b356-ed3c9982414b None None] Registered counter for database nova_cell0 Sep 01 14:04:56.064061 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_db.sqlalchemy.engines [None req-39c20b8d-0272-4679-b356-ed3c9982414b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121340) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 14:04:56.070092 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writer thread running {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 14:04:56.464204 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: WARNING keystonemiddleware.auth_token [None req-39c20b8d-0272-4679-b356-ed3c9982414b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 14:04:56.480149 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: WARNING keystonemiddleware.auth_token [None req-39c20b8d-0272-4679-b356-ed3c9982414b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 14:04:57.147095 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: WARNING keystonemiddleware.auth_token [None req-39c20b8d-0272-4679-b356-ed3c9982414b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 14:04:57.159456 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: WARNING keystonemiddleware.auth_token [None req-39c20b8d-0272-4679-b356-ed3c9982414b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 14:04:57.170804 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: WSGI app 0 (mountpoint='') ready in 9 seconds on interpreter 0x56202d5149c0 pid: 121340 (default app) Sep 01 14:05:34.022371 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_api:SELECT=3 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:05:34.023621 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell0:SELECT=3 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:05:34.030636 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell1:SELECT=3 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:05:34.032077 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell0:SELECT=3 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:05:35.368800 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-780113e0-e658-4bac-b3f3-97df84205af9 tempest-VolumesSnapshotsTestJSON-790604328 tempest-VolumesSnapshotsTestJSON-790604328-project] Action: 'create', calling method: .version_select at 0x7f9868a871f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-477549583"}} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:05:39.133749 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-780113e0-e658-4bac-b3f3-97df84205af9 tempest-VolumesSnapshotsTestJSON-790604328 tempest-VolumesSnapshotsTestJSON-790604328-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 5.122915 Sep 01 14:05:39.135645 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 1/1] 10.222.0.25 () {60 vars in 1155 bytes} [Thu Sep 1 14:05:34 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 5127 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 01 14:05:39.167119 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_api:SELECT=3 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:05:39.170433 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell1:SELECT=3 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:05:39.171971 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell0:SELECT=3 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:05:39.174428 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell0:SELECT=3 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:05:39.621496 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-c17da4ee-cf13-4758-b8a0-ca7adb91533e tempest-VolumesSnapshotsTestJSON-790604328 tempest-VolumesSnapshotsTestJSON-790604328-project] Calling method '.version_select at 0x7f9868ad9dc0>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:41.078274 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-c17da4ee-cf13-4758-b8a0-ca7adb91533e tempest-VolumesSnapshotsTestJSON-790604328 tempest-VolumesSnapshotsTestJSON-790604328-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e48e772e-7084-4b37-bdb0-299055320cab" status: 200 len: 345 microversion: 2.1 time: 1.922350 Sep 01 14:05:41.089244 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 1/2] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 1 14:05:39 2022] GET /compute/v2.1/os-volumes/e48e772e-7084-4b37-bdb0-299055320cab => generated 345 bytes in 1937 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:05:41.099831 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-4c0b164b-9f3f-4bbb-8be5-8c154a86151e tempest-VolumesSnapshotsTestJSON-790604328 tempest-VolumesSnapshotsTestJSON-790604328-project] Action: 'create', calling method: .version_select at 0x7f986896f040>, body: {"snapshot": {"volume_id": "e48e772e-7084-4b37-bdb0-299055320cab", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-721996071"}} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:05:42.042450 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-4c0b164b-9f3f-4bbb-8be5-8c154a86151e tempest-VolumesSnapshotsTestJSON-790604328 tempest-VolumesSnapshotsTestJSON-790604328-project] 10.222.0.25 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.947656 Sep 01 14:05:42.043049 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 2/3] 10.222.0.25 () {60 vars in 1162 bytes} [Thu Sep 1 14:05:41 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:05:42.076298 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-5db910ab-7fc3-473b-927f-c146272e755b tempest-VolumesSnapshotsTestJSON-790604328 tempest-VolumesSnapshotsTestJSON-790604328-project] Calling method '.version_select at 0x7f9868906040>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:42.463207 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-5db910ab-7fc3-473b-927f-c146272e755b tempest-VolumesSnapshotsTestJSON-790604328 tempest-VolumesSnapshotsTestJSON-790604328-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/2e71dde1-597a-4c76-a78e-1078ac1cf889" status: 200 len: 286 microversion: 2.1 time: 0.407865 Sep 01 14:05:42.464217 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 2/4] 10.222.0.25 () {58 vars in 1251 bytes} [Thu Sep 1 14:05:42 2022] GET /compute/v2.1/os-snapshots/2e71dde1-597a-4c76-a78e-1078ac1cf889 => generated 286 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:05:42.477330 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-dac99397-5da0-4168-8701-5ec52c788e43 tempest-VolumesSnapshotsTestJSON-790604328 tempest-VolumesSnapshotsTestJSON-790604328-project] Calling method '.version_select at 0x7f98688f51f0>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:43.144196 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-dac99397-5da0-4168-8701-5ec52c788e43 tempest-VolumesSnapshotsTestJSON-790604328 tempest-VolumesSnapshotsTestJSON-790604328-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.670267 Sep 01 14:05:43.145336 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 3/5] 10.222.0.25 () {58 vars in 1140 bytes} [Thu Sep 1 14:05:42 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:05:43.161561 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-93b9978f-2433-4d21-a06c-3de3a28dd664 tempest-VolumesSnapshotsTestJSON-790604328 tempest-VolumesSnapshotsTestJSON-790604328-project] Calling method '.version_select at 0x7f9868906790>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:43.553491 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-93b9978f-2433-4d21-a06c-3de3a28dd664 tempest-VolumesSnapshotsTestJSON-790604328 tempest-VolumesSnapshotsTestJSON-790604328-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/2e71dde1-597a-4c76-a78e-1078ac1cf889" status: 200 len: 286 microversion: 2.1 time: 0.393268 Sep 01 14:05:43.553491 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 3/6] 10.222.0.25 () {58 vars in 1251 bytes} [Thu Sep 1 14:05:43 2022] GET /compute/v2.1/os-snapshots/2e71dde1-597a-4c76-a78e-1078ac1cf889 => generated 286 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:05:44.567277 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-c771b410-864e-4027-aba3-1aaf4d67af7b tempest-VolumesSnapshotsTestJSON-790604328 tempest-VolumesSnapshotsTestJSON-790604328-project] Calling method '.version_select at 0x7f98688f59d0>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:44.665552 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-c771b410-864e-4027-aba3-1aaf4d67af7b tempest-VolumesSnapshotsTestJSON-790604328 tempest-VolumesSnapshotsTestJSON-790604328-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/2e71dde1-597a-4c76-a78e-1078ac1cf889" status: 200 len: 286 microversion: 2.1 time: 0.106166 Sep 01 14:05:44.666883 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 4/7] 10.222.0.25 () {58 vars in 1251 bytes} [Thu Sep 1 14:05:44 2022] GET /compute/v2.1/os-snapshots/2e71dde1-597a-4c76-a78e-1078ac1cf889 => generated 286 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:05:45.691833 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-a6f0ef86-037f-433d-bfb7-91808596a03d tempest-VolumesSnapshotsTestJSON-790604328 tempest-VolumesSnapshotsTestJSON-790604328-project] Calling method '.version_select at 0x7f9868906e50>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:45.783605 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-a6f0ef86-037f-433d-bfb7-91808596a03d tempest-VolumesSnapshotsTestJSON-790604328 tempest-VolumesSnapshotsTestJSON-790604328-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/2e71dde1-597a-4c76-a78e-1078ac1cf889" status: 200 len: 286 microversion: 2.1 time: 0.103152 Sep 01 14:05:45.793314 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 4/8] 10.222.0.25 () {58 vars in 1251 bytes} [Thu Sep 1 14:05:45 2022] GET /compute/v2.1/os-snapshots/2e71dde1-597a-4c76-a78e-1078ac1cf889 => generated 286 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:05:46.802686 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-2d3994d3-7cd3-4bd6-bbb4-3b0fc2aa4a0b tempest-VolumesSnapshotsTestJSON-790604328 tempest-VolumesSnapshotsTestJSON-790604328-project] Calling method '.version_select at 0x7f98688f54c0>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:46.944549 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-2d3994d3-7cd3-4bd6-bbb4-3b0fc2aa4a0b tempest-VolumesSnapshotsTestJSON-790604328 tempest-VolumesSnapshotsTestJSON-790604328-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/2e71dde1-597a-4c76-a78e-1078ac1cf889" status: 200 len: 287 microversion: 2.1 time: 0.150750 Sep 01 14:05:46.945558 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 5/9] 10.222.0.25 () {58 vars in 1251 bytes} [Thu Sep 1 14:05:46 2022] GET /compute/v2.1/os-snapshots/2e71dde1-597a-4c76-a78e-1078ac1cf889 => generated 287 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:05:46.961263 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-9ea03d8f-d290-43bf-adac-fe3ca3db3715 tempest-VolumesSnapshotsTestJSON-790604328 tempest-VolumesSnapshotsTestJSON-790604328-project] Calling method '.version_select at 0x7f9868906c10>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:47.264944 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-9ea03d8f-d290-43bf-adac-fe3ca3db3715 tempest-VolumesSnapshotsTestJSON-790604328 tempest-VolumesSnapshotsTestJSON-790604328-project] 10.222.0.25 "DELETE /compute/v2.1/os-snapshots/2e71dde1-597a-4c76-a78e-1078ac1cf889" status: 202 len: 0 microversion: 2.1 time: 0.310626 Sep 01 14:05:47.266624 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 5/10] 10.222.0.25 () {58 vars in 1254 bytes} [Thu Sep 1 14:05:46 2022] DELETE /compute/v2.1/os-snapshots/2e71dde1-597a-4c76-a78e-1078ac1cf889 => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:05:47.279226 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-6b7a07a9-8edf-4f5e-8f06-698ea481cdd2 tempest-VolumesSnapshotsTestJSON-790604328 tempest-VolumesSnapshotsTestJSON-790604328-project] Calling method '.version_select at 0x7f986896f0d0>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:47.387340 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-6b7a07a9-8edf-4f5e-8f06-698ea481cdd2 tempest-VolumesSnapshotsTestJSON-790604328 tempest-VolumesSnapshotsTestJSON-790604328-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/2e71dde1-597a-4c76-a78e-1078ac1cf889" status: 200 len: 286 microversion: 2.1 time: 0.115077 Sep 01 14:05:47.388726 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 6/11] 10.222.0.25 () {58 vars in 1251 bytes} [Thu Sep 1 14:05:47 2022] GET /compute/v2.1/os-snapshots/2e71dde1-597a-4c76-a78e-1078ac1cf889 => generated 286 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:05:48.403414 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-98360006-0983-4c55-b33d-3d4d5e5183e7 tempest-VolumesSnapshotsTestJSON-790604328 tempest-VolumesSnapshotsTestJSON-790604328-project] Calling method '.version_select at 0x7f9868906550>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:48.870470 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.wsgi [None req-98360006-0983-4c55-b33d-3d4d5e5183e7 tempest-VolumesSnapshotsTestJSON-790604328 tempest-VolumesSnapshotsTestJSON-790604328-project] HTTP exception thrown: Snapshot 2e71dde1-597a-4c76-a78e-1078ac1cf889 could not be found. Sep 01 14:05:48.874910 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-98360006-0983-4c55-b33d-3d4d5e5183e7 tempest-VolumesSnapshotsTestJSON-790604328 tempest-VolumesSnapshotsTestJSON-790604328-project] Request method failure captured: Sep 01 14:05:48.874910 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: request: GET /compute/v2.1/os-snapshots/2e71dde1-597a-4c76-a78e-1078ac1cf889 HTTP/1.1 Sep 01 14:05:48.874910 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept: application/json Sep 01 14:05:48.874910 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept-Encoding: identity Sep 01 14:05:48.874910 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Connection: close Sep 01 14:05:48.874910 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Length: 0 Sep 01 14:05:48.874910 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Type: application/json Sep 01 14:05:48.874910 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Host: 10.222.0.25 Sep 01 14:05:48.874910 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Openstack-System-Scope: None Sep 01 14:05:48.874910 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: User-Agent: python-urllib3/1.26.12 Sep 01 14:05:48.874910 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Auth-Token: gAAAAABjELwtRF98EzFzEP5os0PkUayd1MiRMIH7ZpNJkQgixDKws0fbpxQIO3MkOALhv7QAea6Oq85ptGD2UGcldUySvr2sSN89kMqhCi6VjISJ9sH1UILByJbxZSQwTYlbDmcOXaIXBOc2jFryOtLS51AWHCfGP4oQVT6yLOIfupNHx4kEz3Q Sep 01 14:05:48.874910 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Id: None Sep 01 14:05:48.874910 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Name: None Sep 01 14:05:48.874910 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Identity-Status: Confirmed Sep 01 14:05:48.874910 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Is-Admin-Project: True Sep 01 14:05:48.874910 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Id: default Sep 01 14:05:48.874910 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Name: Default Sep 01 14:05:48.874910 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Id: 238327a3ec7946ada50cc2a71d542415 Sep 01 14:05:48.874910 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-790604328 Sep 01 14:05:48.874910 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Role: member,reader Sep 01 14:05:48.874910 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Roles: member,reader Sep 01 14:05:48.876667 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/238327a3ec7946ada50cc2a71d542415"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/238327a3ec7946ada50cc2a71d542415"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/238327a3ec7946ada50cc2a71d542415"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_238327a3ec7946ada50cc2a71d542415"}]}] Sep 01 14:05:48.876667 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant: tempest-VolumesSnapshotsTestJSON-790604328 Sep 01 14:05:48.876667 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Id: 238327a3ec7946ada50cc2a71d542415 Sep 01 14:05:48.876667 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-790604328 Sep 01 14:05:48.876667 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User: tempest-VolumesSnapshotsTestJSON-790604328-project Sep 01 14:05:48.876667 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Id: default Sep 01 14:05:48.876667 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Name: Default Sep 01 14:05:48.876667 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Id: d58fb7cea93a4b46ada7e58657768096 Sep 01 14:05:48.876667 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Name: tempest-VolumesSnapshotsTestJSON-790604328-project Sep 01 14:05:48.876667 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: method: Sep 01 14:05:48.876667 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: exception: Snapshot 2e71dde1-597a-4c76-a78e-1078ac1cf889 could not be found. Sep 01 14:05:48.876667 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: action_args: {'id': '2e71dde1-597a-4c76-a78e-1078ac1cf889'} Sep 01 14:05:48.876667 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:05:48.877483 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:05:48.877483 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 01 14:05:48.877483 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 01 14:05:48.877483 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 01 14:05:48.877483 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 01 14:05:48.877483 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 01 14:05:48.877483 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 01 14:05:48.877483 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 14:05:48.877483 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 14:05:48.877483 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 14:05:48.877483 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 14:05:48.877483 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:05:48.877483 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:05:48.877483 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:05:48.877483 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:05:48.877483 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 2e71dde1-597a-4c76-a78e-1078ac1cf889 could not be found. (HTTP 404) (Request-ID: req-6acd04af-5bfc-48f9-920f-abc8ec43f847) Sep 01 14:05:48.877483 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:05:48.877483 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:05:48.878404 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:05:48.878404 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:05:48.878404 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 01 14:05:48.878404 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 01 14:05:48.878404 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 14:05:48.878404 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 14:05:48.878404 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 01 14:05:48.878404 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 01 14:05:48.878404 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 14:05:48.878404 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 14:05:48.878404 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 01 14:05:48.878404 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 01 14:05:48.878404 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 01 14:05:48.878404 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 01 14:05:48.878404 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 01 14:05:48.878404 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 01 14:05:48.878404 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 14:05:48.878404 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 14:05:48.878404 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 14:05:48.879325 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 14:05:48.879325 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:05:48.879325 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:05:48.879325 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:05:48.879325 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:05:48.879325 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 2e71dde1-597a-4c76-a78e-1078ac1cf889 could not be found. Sep 01 14:05:48.879325 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:05:48.879325 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:05:48.879325 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:05:48.879325 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:05:48.879325 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:05:48.879325 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:05:48.879325 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:05:48.879325 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:05:48.879325 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 14:05:48.879325 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 14:05:48.879325 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:05:48.879325 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:05:48.879325 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 01 14:05:48.879325 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:05:48.883487 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 2e71dde1-597a-4c76-a78e-1078ac1cf889 could not be found. Sep 01 14:05:48.883487 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:05:48.883487 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:05:48.883487 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:05:48.883487 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:05:48.883487 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:05:48.883487 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:05:48.883487 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:05:48.883487 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:05:48.883487 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 2e71dde1-597a-4c76-a78e-1078ac1cf889 could not be found. Sep 01 14:05:48.883487 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:05:48.883487 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-98360006-0983-4c55-b33d-3d4d5e5183e7 tempest-VolumesSnapshotsTestJSON-790604328 tempest-VolumesSnapshotsTestJSON-790604328-project] Returning 404 to user: Snapshot 2e71dde1-597a-4c76-a78e-1078ac1cf889 could not be found. {{(pid=121340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:05:48.883487 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-98360006-0983-4c55-b33d-3d4d5e5183e7 tempest-VolumesSnapshotsTestJSON-790604328 tempest-VolumesSnapshotsTestJSON-790604328-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/2e71dde1-597a-4c76-a78e-1078ac1cf889" status: 404 len: 111 microversion: 2.1 time: 0.479664 Sep 01 14:05:48.883487 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 6/12] 10.222.0.25 () {58 vars in 1251 bytes} [Thu Sep 1 14:05:48 2022] GET /compute/v2.1/os-snapshots/2e71dde1-597a-4c76-a78e-1078ac1cf889 => generated 111 bytes in 481 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:05:48.887643 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-1003295f-6e54-48a3-90c7-70e2b0e479c3 tempest-VolumesSnapshotsTestJSON-790604328 tempest-VolumesSnapshotsTestJSON-790604328-project] Calling method '.version_select at 0x7f98688f5310>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:49.324339 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-1003295f-6e54-48a3-90c7-70e2b0e479c3 tempest-VolumesSnapshotsTestJSON-790604328 tempest-VolumesSnapshotsTestJSON-790604328-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/e48e772e-7084-4b37-bdb0-299055320cab" status: 202 len: 0 microversion: 2.1 time: 0.440490 Sep 01 14:05:49.325141 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 7/13] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Sep 1 14:05:48 2022] DELETE /compute/v2.1/os-volumes/e48e772e-7084-4b37-bdb0-299055320cab => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:05:49.336569 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-3f6bb867-7dde-4cef-8efe-f146c0dee02c tempest-VolumesSnapshotsTestJSON-790604328 tempest-VolumesSnapshotsTestJSON-790604328-project] Calling method '.version_select at 0x7f98688db940>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:49.607491 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-3f6bb867-7dde-4cef-8efe-f146c0dee02c tempest-VolumesSnapshotsTestJSON-790604328 tempest-VolumesSnapshotsTestJSON-790604328-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e48e772e-7084-4b37-bdb0-299055320cab" status: 200 len: 344 microversion: 2.1 time: 0.275162 Sep 01 14:05:49.609084 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 7/14] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 1 14:05:49 2022] GET /compute/v2.1/os-volumes/e48e772e-7084-4b37-bdb0-299055320cab => generated 344 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:05:50.640228 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-1adee5a0-c64c-4ef7-965f-5557f138b1f3 tempest-VolumesSnapshotsTestJSON-790604328 tempest-VolumesSnapshotsTestJSON-790604328-project] Calling method '.version_select at 0x7f98688f59d0>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:50.757690 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-1adee5a0-c64c-4ef7-965f-5557f138b1f3 tempest-VolumesSnapshotsTestJSON-790604328 tempest-VolumesSnapshotsTestJSON-790604328-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e48e772e-7084-4b37-bdb0-299055320cab" status: 200 len: 344 microversion: 2.1 time: 0.133783 Sep 01 14:05:50.758889 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 8/15] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 1 14:05:50 2022] GET /compute/v2.1/os-volumes/e48e772e-7084-4b37-bdb0-299055320cab => generated 344 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:05:51.780232 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-fbdf51c2-820a-4eac-922d-5d80ac0da3c4 tempest-VolumesSnapshotsTestJSON-790604328 tempest-VolumesSnapshotsTestJSON-790604328-project] Calling method '.version_select at 0x7f98688ef0d0>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:51.946461 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-fbdf51c2-820a-4eac-922d-5d80ac0da3c4 tempest-VolumesSnapshotsTestJSON-790604328 tempest-VolumesSnapshotsTestJSON-790604328-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e48e772e-7084-4b37-bdb0-299055320cab" status: 200 len: 344 microversion: 2.1 time: 0.172454 Sep 01 14:05:51.948386 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 8/16] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 1 14:05:51 2022] GET /compute/v2.1/os-volumes/e48e772e-7084-4b37-bdb0-299055320cab => generated 344 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:05:52.961518 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-bcf8ff8f-b8cc-4a71-9f24-68af71b9ddd4 tempest-VolumesSnapshotsTestJSON-790604328 tempest-VolumesSnapshotsTestJSON-790604328-project] Calling method '.version_select at 0x7f986896faf0>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:53.026027 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.wsgi [None req-bcf8ff8f-b8cc-4a71-9f24-68af71b9ddd4 tempest-VolumesSnapshotsTestJSON-790604328 tempest-VolumesSnapshotsTestJSON-790604328-project] HTTP exception thrown: Volume e48e772e-7084-4b37-bdb0-299055320cab could not be found. Sep 01 14:05:53.030185 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-bcf8ff8f-b8cc-4a71-9f24-68af71b9ddd4 tempest-VolumesSnapshotsTestJSON-790604328 tempest-VolumesSnapshotsTestJSON-790604328-project] Request method failure captured: Sep 01 14:05:53.030185 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: request: GET /compute/v2.1/os-volumes/e48e772e-7084-4b37-bdb0-299055320cab HTTP/1.1 Sep 01 14:05:53.030185 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept: application/json Sep 01 14:05:53.030185 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept-Encoding: identity Sep 01 14:05:53.030185 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Connection: close Sep 01 14:05:53.030185 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Length: 0 Sep 01 14:05:53.030185 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Type: application/json Sep 01 14:05:53.030185 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Host: 10.222.0.25 Sep 01 14:05:53.030185 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Openstack-System-Scope: None Sep 01 14:05:53.030185 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: User-Agent: python-urllib3/1.26.12 Sep 01 14:05:53.030185 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Auth-Token: gAAAAABjELwtRF98EzFzEP5os0PkUayd1MiRMIH7ZpNJkQgixDKws0fbpxQIO3MkOALhv7QAea6Oq85ptGD2UGcldUySvr2sSN89kMqhCi6VjISJ9sH1UILByJbxZSQwTYlbDmcOXaIXBOc2jFryOtLS51AWHCfGP4oQVT6yLOIfupNHx4kEz3Q Sep 01 14:05:53.030185 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Id: None Sep 01 14:05:53.030185 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Name: None Sep 01 14:05:53.030185 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Identity-Status: Confirmed Sep 01 14:05:53.030185 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Is-Admin-Project: True Sep 01 14:05:53.030185 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Id: default Sep 01 14:05:53.030185 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Name: Default Sep 01 14:05:53.030185 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Id: 238327a3ec7946ada50cc2a71d542415 Sep 01 14:05:53.030185 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-790604328 Sep 01 14:05:53.030185 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Role: member,reader Sep 01 14:05:53.030185 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Roles: member,reader Sep 01 14:05:53.047092 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/238327a3ec7946ada50cc2a71d542415"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/238327a3ec7946ada50cc2a71d542415"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/238327a3ec7946ada50cc2a71d542415"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_238327a3ec7946ada50cc2a71d542415"}]}] Sep 01 14:05:53.047092 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant: tempest-VolumesSnapshotsTestJSON-790604328 Sep 01 14:05:53.047092 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Id: 238327a3ec7946ada50cc2a71d542415 Sep 01 14:05:53.047092 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-790604328 Sep 01 14:05:53.047092 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User: tempest-VolumesSnapshotsTestJSON-790604328-project Sep 01 14:05:53.047092 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Id: default Sep 01 14:05:53.047092 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Name: Default Sep 01 14:05:53.047092 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Id: d58fb7cea93a4b46ada7e58657768096 Sep 01 14:05:53.047092 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Name: tempest-VolumesSnapshotsTestJSON-790604328-project Sep 01 14:05:53.047092 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: method: Sep 01 14:05:53.047092 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: exception: Volume e48e772e-7084-4b37-bdb0-299055320cab could not be found. Sep 01 14:05:53.047092 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: action_args: {'id': 'e48e772e-7084-4b37-bdb0-299055320cab'} Sep 01 14:05:53.047092 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:05:53.047839 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:05:53.047839 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 14:05:53.047839 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 14:05:53.047839 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 14:05:53.047839 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 14:05:53.047839 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 14:05:53.047839 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 14:05:53.047839 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 14:05:53.047839 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 14:05:53.047839 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 14:05:53.047839 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 14:05:53.047839 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:05:53.047839 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:05:53.047839 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:05:53.047839 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:05:53.047839 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e48e772e-7084-4b37-bdb0-299055320cab could not be found. (HTTP 404) (Request-ID: req-6ef1b0ea-2d1d-48f0-bdf1-3038b5295180) Sep 01 14:05:53.047839 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:05:53.047839 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:05:53.047839 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:05:53.048836 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:05:53.048836 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 14:05:53.048836 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 14:05:53.048836 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 14:05:53.048836 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 14:05:53.048836 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 14:05:53.048836 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 14:05:53.048836 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 14:05:53.048836 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 14:05:53.048836 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 14:05:53.048836 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 14:05:53.048836 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 14:05:53.048836 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 14:05:53.048836 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 14:05:53.048836 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 14:05:53.048836 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 14:05:53.048836 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 14:05:53.048836 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 14:05:53.048836 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 14:05:53.049702 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:05:53.049702 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:05:53.049702 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:05:53.049702 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:05:53.049702 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e48e772e-7084-4b37-bdb0-299055320cab could not be found. Sep 01 14:05:53.049702 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:05:53.049702 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:05:53.049702 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:05:53.049702 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:05:53.049702 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:05:53.049702 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:05:53.049702 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:05:53.049702 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:05:53.049702 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 14:05:53.049702 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 14:05:53.049702 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:05:53.049702 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:05:53.049702 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 14:05:53.049702 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:05:53.054157 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e48e772e-7084-4b37-bdb0-299055320cab could not be found. Sep 01 14:05:53.054157 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:05:53.054157 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:05:53.054157 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:05:53.054157 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:05:53.054157 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:05:53.054157 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:05:53.054157 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:05:53.054157 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:05:53.054157 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e48e772e-7084-4b37-bdb0-299055320cab could not be found. Sep 01 14:05:53.054157 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:05:53.054157 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-bcf8ff8f-b8cc-4a71-9f24-68af71b9ddd4 tempest-VolumesSnapshotsTestJSON-790604328 tempest-VolumesSnapshotsTestJSON-790604328-project] Returning 404 to user: Volume e48e772e-7084-4b37-bdb0-299055320cab could not be found. {{(pid=121339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:05:53.054157 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-bcf8ff8f-b8cc-4a71-9f24-68af71b9ddd4 tempest-VolumesSnapshotsTestJSON-790604328 tempest-VolumesSnapshotsTestJSON-790604328-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e48e772e-7084-4b37-bdb0-299055320cab" status: 404 len: 109 microversion: 2.1 time: 0.074357 Sep 01 14:05:53.054157 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 9/17] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 1 14:05:52 2022] GET /compute/v2.1/os-volumes/e48e772e-7084-4b37-bdb0-299055320cab => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:05:53.055678 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-f2f6c4c9-281c-497a-891a-8314259663ce tempest-VolumesSnapshotsTestJSON-790604328 tempest-VolumesSnapshotsTestJSON-790604328-project] Calling method '.version_select at 0x7f98688ef700>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:53.121885 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.wsgi [None req-f2f6c4c9-281c-497a-891a-8314259663ce tempest-VolumesSnapshotsTestJSON-790604328 tempest-VolumesSnapshotsTestJSON-790604328-project] HTTP exception thrown: Volume e48e772e-7084-4b37-bdb0-299055320cab could not be found. Sep 01 14:05:53.130006 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-f2f6c4c9-281c-497a-891a-8314259663ce tempest-VolumesSnapshotsTestJSON-790604328 tempest-VolumesSnapshotsTestJSON-790604328-project] Request method failure captured: Sep 01 14:05:53.130006 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: request: DELETE /compute/v2.1/os-volumes/e48e772e-7084-4b37-bdb0-299055320cab HTTP/1.1 Sep 01 14:05:53.130006 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept: application/json Sep 01 14:05:53.130006 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept-Encoding: identity Sep 01 14:05:53.130006 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Connection: close Sep 01 14:05:53.130006 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Length: 0 Sep 01 14:05:53.130006 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Type: application/json Sep 01 14:05:53.130006 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Host: 10.222.0.25 Sep 01 14:05:53.130006 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Openstack-System-Scope: None Sep 01 14:05:53.130006 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: User-Agent: python-urllib3/1.26.12 Sep 01 14:05:53.130006 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Auth-Token: gAAAAABjELwtRF98EzFzEP5os0PkUayd1MiRMIH7ZpNJkQgixDKws0fbpxQIO3MkOALhv7QAea6Oq85ptGD2UGcldUySvr2sSN89kMqhCi6VjISJ9sH1UILByJbxZSQwTYlbDmcOXaIXBOc2jFryOtLS51AWHCfGP4oQVT6yLOIfupNHx4kEz3Q Sep 01 14:05:53.130006 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Id: None Sep 01 14:05:53.130006 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Name: None Sep 01 14:05:53.130006 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Identity-Status: Confirmed Sep 01 14:05:53.130006 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Is-Admin-Project: True Sep 01 14:05:53.130006 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Id: default Sep 01 14:05:53.130006 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Name: Default Sep 01 14:05:53.130006 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Id: 238327a3ec7946ada50cc2a71d542415 Sep 01 14:05:53.130006 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-790604328 Sep 01 14:05:53.130006 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Role: member,reader Sep 01 14:05:53.130006 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Roles: member,reader Sep 01 14:05:53.131054 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/238327a3ec7946ada50cc2a71d542415"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/238327a3ec7946ada50cc2a71d542415"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/238327a3ec7946ada50cc2a71d542415"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_238327a3ec7946ada50cc2a71d542415"}]}] Sep 01 14:05:53.131054 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant: tempest-VolumesSnapshotsTestJSON-790604328 Sep 01 14:05:53.131054 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Id: 238327a3ec7946ada50cc2a71d542415 Sep 01 14:05:53.131054 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-790604328 Sep 01 14:05:53.131054 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User: tempest-VolumesSnapshotsTestJSON-790604328-project Sep 01 14:05:53.131054 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Id: default Sep 01 14:05:53.131054 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Name: Default Sep 01 14:05:53.131054 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Id: d58fb7cea93a4b46ada7e58657768096 Sep 01 14:05:53.131054 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Name: tempest-VolumesSnapshotsTestJSON-790604328-project Sep 01 14:05:53.131054 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: method: Sep 01 14:05:53.131054 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: exception: Volume e48e772e-7084-4b37-bdb0-299055320cab could not be found. Sep 01 14:05:53.131054 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: action_args: {'id': 'e48e772e-7084-4b37-bdb0-299055320cab'} Sep 01 14:05:53.131054 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:05:53.131660 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:05:53.131660 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 14:05:53.131660 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 14:05:53.131660 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 14:05:53.131660 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 14:05:53.131660 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 14:05:53.131660 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 14:05:53.131660 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 14:05:53.131660 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 14:05:53.131660 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 14:05:53.131660 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 14:05:53.131660 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:05:53.131660 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:05:53.131660 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:05:53.131660 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:05:53.131660 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e48e772e-7084-4b37-bdb0-299055320cab could not be found. (HTTP 404) (Request-ID: req-92516657-3ea5-48a3-9807-016698ab5052) Sep 01 14:05:53.131660 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:05:53.131660 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:05:53.131660 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:05:53.132603 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:05:53.132603 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 14:05:53.132603 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 14:05:53.132603 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 14:05:53.132603 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 14:05:53.132603 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 14:05:53.132603 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 14:05:53.132603 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 14:05:53.132603 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 14:05:53.132603 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 14:05:53.132603 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 14:05:53.132603 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 14:05:53.132603 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 14:05:53.132603 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 14:05:53.132603 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 14:05:53.132603 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 14:05:53.132603 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 14:05:53.132603 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 14:05:53.132603 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 14:05:53.133496 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:05:53.133496 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:05:53.133496 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:05:53.133496 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:05:53.133496 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e48e772e-7084-4b37-bdb0-299055320cab could not be found. Sep 01 14:05:53.133496 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:05:53.133496 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:05:53.133496 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:05:53.133496 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:05:53.133496 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:05:53.133496 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:05:53.133496 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:05:53.133496 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:05:53.133496 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 14:05:53.133496 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 14:05:53.133496 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:05:53.133496 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:05:53.133496 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 14:05:53.133496 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:05:53.134605 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e48e772e-7084-4b37-bdb0-299055320cab could not be found. Sep 01 14:05:53.134605 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:05:53.134605 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:05:53.134605 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:05:53.134605 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:05:53.134605 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:05:53.134605 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:05:53.134605 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:05:53.134605 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:05:53.134605 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e48e772e-7084-4b37-bdb0-299055320cab could not be found. Sep 01 14:05:53.134605 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:05:53.134605 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-f2f6c4c9-281c-497a-891a-8314259663ce tempest-VolumesSnapshotsTestJSON-790604328 tempest-VolumesSnapshotsTestJSON-790604328-project] Returning 404 to user: Volume e48e772e-7084-4b37-bdb0-299055320cab could not be found. {{(pid=121340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:05:53.134605 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-f2f6c4c9-281c-497a-891a-8314259663ce tempest-VolumesSnapshotsTestJSON-790604328 tempest-VolumesSnapshotsTestJSON-790604328-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/e48e772e-7084-4b37-bdb0-299055320cab" status: 404 len: 109 microversion: 2.1 time: 0.078274 Sep 01 14:05:53.134605 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 9/18] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Sep 1 14:05:53 2022] DELETE /compute/v2.1/os-volumes/e48e772e-7084-4b37-bdb0-299055320cab => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:05:53.141036 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-1a8b4b40-4568-4437-aa30-43060e58ab46 tempest-VolumesSnapshotsTestJSON-790604328 tempest-VolumesSnapshotsTestJSON-790604328-project] Calling method '.version_select at 0x7f986896f160>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:53.350451 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.wsgi [None req-1a8b4b40-4568-4437-aa30-43060e58ab46 tempest-VolumesSnapshotsTestJSON-790604328 tempest-VolumesSnapshotsTestJSON-790604328-project] HTTP exception thrown: Volume e48e772e-7084-4b37-bdb0-299055320cab could not be found. Sep 01 14:05:53.356097 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-1a8b4b40-4568-4437-aa30-43060e58ab46 tempest-VolumesSnapshotsTestJSON-790604328 tempest-VolumesSnapshotsTestJSON-790604328-project] Request method failure captured: Sep 01 14:05:53.356097 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: request: GET /compute/v2.1/os-volumes/e48e772e-7084-4b37-bdb0-299055320cab HTTP/1.1 Sep 01 14:05:53.356097 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept: application/json Sep 01 14:05:53.356097 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept-Encoding: identity Sep 01 14:05:53.356097 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Connection: close Sep 01 14:05:53.356097 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Length: 0 Sep 01 14:05:53.356097 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Type: application/json Sep 01 14:05:53.356097 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Host: 10.222.0.25 Sep 01 14:05:53.356097 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Openstack-System-Scope: None Sep 01 14:05:53.356097 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: User-Agent: python-urllib3/1.26.12 Sep 01 14:05:53.356097 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Auth-Token: gAAAAABjELwtRF98EzFzEP5os0PkUayd1MiRMIH7ZpNJkQgixDKws0fbpxQIO3MkOALhv7QAea6Oq85ptGD2UGcldUySvr2sSN89kMqhCi6VjISJ9sH1UILByJbxZSQwTYlbDmcOXaIXBOc2jFryOtLS51AWHCfGP4oQVT6yLOIfupNHx4kEz3Q Sep 01 14:05:53.356097 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Id: None Sep 01 14:05:53.356097 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Name: None Sep 01 14:05:53.356097 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Identity-Status: Confirmed Sep 01 14:05:53.356097 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Is-Admin-Project: True Sep 01 14:05:53.356097 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Id: default Sep 01 14:05:53.356097 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Name: Default Sep 01 14:05:53.356097 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Id: 238327a3ec7946ada50cc2a71d542415 Sep 01 14:05:53.356097 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-790604328 Sep 01 14:05:53.356097 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Role: member,reader Sep 01 14:05:53.356097 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Roles: member,reader Sep 01 14:05:53.358083 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/238327a3ec7946ada50cc2a71d542415"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/238327a3ec7946ada50cc2a71d542415"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/238327a3ec7946ada50cc2a71d542415"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_238327a3ec7946ada50cc2a71d542415"}]}] Sep 01 14:05:53.358083 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant: tempest-VolumesSnapshotsTestJSON-790604328 Sep 01 14:05:53.358083 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Id: 238327a3ec7946ada50cc2a71d542415 Sep 01 14:05:53.358083 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-790604328 Sep 01 14:05:53.358083 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User: tempest-VolumesSnapshotsTestJSON-790604328-project Sep 01 14:05:53.358083 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Id: default Sep 01 14:05:53.358083 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Name: Default Sep 01 14:05:53.358083 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Id: d58fb7cea93a4b46ada7e58657768096 Sep 01 14:05:53.358083 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Name: tempest-VolumesSnapshotsTestJSON-790604328-project Sep 01 14:05:53.358083 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: method: Sep 01 14:05:53.358083 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: exception: Volume e48e772e-7084-4b37-bdb0-299055320cab could not be found. Sep 01 14:05:53.358083 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: action_args: {'id': 'e48e772e-7084-4b37-bdb0-299055320cab'} Sep 01 14:05:53.358083 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:05:53.359358 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:05:53.359358 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 14:05:53.359358 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 14:05:53.359358 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 14:05:53.359358 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 14:05:53.359358 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 14:05:53.359358 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 14:05:53.359358 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 14:05:53.359358 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 14:05:53.359358 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 14:05:53.359358 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 14:05:53.359358 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:05:53.359358 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:05:53.359358 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:05:53.359358 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:05:53.359358 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e48e772e-7084-4b37-bdb0-299055320cab could not be found. (HTTP 404) (Request-ID: req-16163054-35bb-4fce-8205-7c86ef7c2618) Sep 01 14:05:53.359358 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:05:53.359358 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:05:53.359358 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:05:53.361698 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:05:53.361698 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 14:05:53.361698 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 14:05:53.361698 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 14:05:53.361698 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 14:05:53.361698 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 14:05:53.361698 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 14:05:53.361698 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 14:05:53.361698 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 14:05:53.361698 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 14:05:53.361698 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 14:05:53.361698 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 14:05:53.361698 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 14:05:53.361698 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 14:05:53.361698 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 14:05:53.361698 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 14:05:53.361698 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 14:05:53.361698 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 14:05:53.361698 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 14:05:53.368977 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:05:53.368977 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:05:53.368977 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:05:53.368977 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:05:53.368977 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e48e772e-7084-4b37-bdb0-299055320cab could not be found. Sep 01 14:05:53.368977 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:05:53.368977 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:05:53.368977 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:05:53.368977 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:05:53.368977 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:05:53.368977 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:05:53.368977 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:05:53.368977 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:05:53.368977 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 14:05:53.368977 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 14:05:53.368977 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:05:53.368977 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:05:53.368977 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 14:05:53.368977 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:05:53.372487 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e48e772e-7084-4b37-bdb0-299055320cab could not be found. Sep 01 14:05:53.372487 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:05:53.372487 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:05:53.372487 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:05:53.372487 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:05:53.372487 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:05:53.372487 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:05:53.372487 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:05:53.372487 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:05:53.372487 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e48e772e-7084-4b37-bdb0-299055320cab could not be found. Sep 01 14:05:53.372487 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:05:53.378012 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-1a8b4b40-4568-4437-aa30-43060e58ab46 tempest-VolumesSnapshotsTestJSON-790604328 tempest-VolumesSnapshotsTestJSON-790604328-project] Returning 404 to user: Volume e48e772e-7084-4b37-bdb0-299055320cab could not be found. {{(pid=121339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:05:53.378012 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-1a8b4b40-4568-4437-aa30-43060e58ab46 tempest-VolumesSnapshotsTestJSON-790604328 tempest-VolumesSnapshotsTestJSON-790604328-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/e48e772e-7084-4b37-bdb0-299055320cab" status: 404 len: 109 microversion: 2.1 time: 0.245569 Sep 01 14:05:53.392146 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 10/19] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 1 14:05:53 2022] GET /compute/v2.1/os-volumes/e48e772e-7084-4b37-bdb0-299055320cab => generated 109 bytes in 261 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:05:55.072872 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-20691ad9-7e1f-45e7-bacc-9c1882264238 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2085504603", "imageRef": "9be77128-e763-4225-b76f-85fbb04ad9b2", "flavorRef": "452", "networks": [{"uuid": "16a106e2-cc97-4518-b881-ae2a1035d4e5"}]}} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:05:55.313144 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.network.neutron [None req-20691ad9-7e1f-45e7-bacc-9c1882264238 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] validate_networks() for [('16a106e2-cc97-4518-b881-ae2a1035d4e5', None, None, None, None, None)] {{(pid=121340) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:05:57.765263 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-20691ad9-7e1f-45e7-bacc-9c1882264238 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Flavor limits 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:05:57.765874 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-20691ad9-7e1f-45e7-bacc-9c1882264238 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Image limits 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:05:57.766239 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-20691ad9-7e1f-45e7-bacc-9c1882264238 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Flavor pref 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:05:57.766832 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-20691ad9-7e1f-45e7-bacc-9c1882264238 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Image pref 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:05:57.767781 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-20691ad9-7e1f-45e7-bacc-9c1882264238 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:05:57.827977 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-20691ad9-7e1f-45e7-bacc-9c1882264238 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:57.828775 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-20691ad9-7e1f-45e7-bacc-9c1882264238 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:57.833632 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-20691ad9-7e1f-45e7-bacc-9c1882264238 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:57.837562 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-20691ad9-7e1f-45e7-bacc-9c1882264238 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:57.847798 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-20691ad9-7e1f-45e7-bacc-9c1882264238 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:57.850565 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-20691ad9-7e1f-45e7-bacc-9c1882264238 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:58.068271 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.quota [None req-20691ad9-7e1f-45e7-bacc-9c1882264238 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Getting quotas for project f871b0e1d3154b6d8c297b12ae738be0. Resources: {'cores', 'instances', 'ram'} {{(pid=121340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:05:58.093495 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.quota [None req-20691ad9-7e1f-45e7-bacc-9c1882264238 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Getting quotas for user c5b991f5024e4b5dbe8510b7381b1dc8 and project f871b0e1d3154b6d8c297b12ae738be0. Resources: {'cores', 'instances', 'ram'} {{(pid=121340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:05:58.129377 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-20691ad9-7e1f-45e7-bacc-9c1882264238 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Going to run 1 instances... {{(pid=121340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:05:58.136176 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-20691ad9-7e1f-45e7-bacc-9c1882264238 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] [instance: 3000b992-fcbf-472e-a1e0-11b101af43a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9be77128-e763-4225-b76f-85fbb04ad9b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:05:58.437455 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-20691ad9-7e1f-45e7-bacc-9c1882264238 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.692030 Sep 01 14:05:58.441798 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 10/20] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 1 14:05:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 3705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 14:05:58.479527 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-ff133e13-db83-46ee-9953-122aca607009 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:58.486020 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-ff133e13-db83-46ee-9953-122aca607009 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] [instance: 3000b992-fcbf-472e-a1e0-11b101af43a7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:59.419262 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-ff133e13-db83-46ee-9953-122aca607009 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b991f5024e4b5dbe8510b7381b1dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f871b0e1d3154b6d8c297b12ae738be0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:59.512061 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-ff133e13-db83-46ee-9953-122aca607009 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] 10.222.0.25 "GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7" status: 200 len: 1215 microversion: 2.1 time: 1.048131 Sep 01 14:05:59.519070 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 11/21] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:58 2022] GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7 => generated 1215 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:05:59.596108 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-3cedff34-def4-466b-9ab7-f2ab80feebd9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Action: 'create', calling method: .version_select at 0x7f9867f81e50>, body: {"keypair": {"name": "tempest-keypair-1128071397", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfrUGtCHChxgUfgakTijunFZTRmW6leYkkGOn/hOiJTOhvE48N3jR6zfxen7d1tRQ16Vd7YJWHy7w4Ue4vkfv/1s6poM5BakZtLjb2vE+Kz7BVF7kAeLy8/753jTVqFMQ=="}} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:05:59.800596 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.quota [None req-3cedff34-def4-466b-9ab7-f2ab80feebd9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Getting quotas for project 3ed58deb61194a5ba3f2d46eb7e5680c. Resources: {'key_pairs'} {{(pid=121340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:05:59.820743 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.quota [None req-3cedff34-def4-466b-9ab7-f2ab80feebd9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Getting quotas for user 61401557e7624580b20de6e31c92f785 and project 3ed58deb61194a5ba3f2d46eb7e5680c. Resources: {'key_pairs'} {{(pid=121340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:06:00.178738 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-3cedff34-def4-466b-9ab7-f2ab80feebd9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.865443 Sep 01 14:06:00.180541 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 11/22] 10.222.0.25 () {62 vars in 1200 bytes} [Thu Sep 1 14:05:59 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 870 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 01 14:06:00.579684 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-7943c7de-3b99-484a-80c3-be78ac74619d tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:00.613619 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-7943c7de-3b99-484a-80c3-be78ac74619d tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] [instance: 3000b992-fcbf-472e-a1e0-11b101af43a7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:00.812257 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-7943c7de-3b99-484a-80c3-be78ac74619d tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b991f5024e4b5dbe8510b7381b1dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f871b0e1d3154b6d8c297b12ae738be0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:00.821562 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-7943c7de-3b99-484a-80c3-be78ac74619d tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] 10.222.0.25 "GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7" status: 200 len: 1215 microversion: 2.1 time: 0.268471 Sep 01 14:06:00.822355 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 12/23] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:00 2022] GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7 => generated 1215 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:01.849636 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-76483c5d-4e5e-45f0-b203-04939ece248e tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:01.851039 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-76483c5d-4e5e-45f0-b203-04939ece248e tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] [instance: 3000b992-fcbf-472e-a1e0-11b101af43a7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:02.129499 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-76483c5d-4e5e-45f0-b203-04939ece248e tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b991f5024e4b5dbe8510b7381b1dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f871b0e1d3154b6d8c297b12ae738be0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:02.176216 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-76483c5d-4e5e-45f0-b203-04939ece248e tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] 10.222.0.25 "GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7" status: 200 len: 1215 microversion: 2.1 time: 0.314847 Sep 01 14:06:02.177113 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 13/24] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:01 2022] GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7 => generated 1215 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:02.278789 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-499a6db5-c131-4385-815c-851117900f73 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Action: 'create', calling method: .version_select at 0x7f9867fa13a0>, body: {"keypair": {"name": "tempest-keypair-622888630", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESl+xdUPhw0klRjlP67pLY6gUvNKkErOBKMW7iXJvpDUYI+uR63cC2R6FDS0yvOa/g5VoHAx78PUwnJW/lNjeNOq1Bi+NXg8H6Ic8ih07HDdQYDd60bPr4nGKR12exJKQ=="}} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:06:02.424252 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.quota [None req-499a6db5-c131-4385-815c-851117900f73 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Getting quotas for project eaba67e3a54f4191b9b924305a83e4eb. Resources: {'key_pairs'} {{(pid=121340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:06:02.474347 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.quota [None req-499a6db5-c131-4385-815c-851117900f73 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Getting quotas for user ff664c7ba095413daad6b3f1ebc49cc0 and project eaba67e3a54f4191b9b924305a83e4eb. Resources: {'key_pairs'} {{(pid=121340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:06:02.710417 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-499a6db5-c131-4385-815c-851117900f73 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.038998 Sep 01 14:06:02.712346 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 12/25] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Sep 1 14:06:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:06:03.222246 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-02129357-35d3-4dde-a9c1-bbf937965549 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:03.223934 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-02129357-35d3-4dde-a9c1-bbf937965549 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] [instance: 3000b992-fcbf-472e-a1e0-11b101af43a7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:03.260289 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-02129357-35d3-4dde-a9c1-bbf937965549 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:03.275468 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-02129357-35d3-4dde-a9c1-bbf937965549 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:03.276911 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-02129357-35d3-4dde-a9c1-bbf937965549 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:03.278676 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-02129357-35d3-4dde-a9c1-bbf937965549 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:03.280015 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-02129357-35d3-4dde-a9c1-bbf937965549 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:03.281127 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-02129357-35d3-4dde-a9c1-bbf937965549 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:03.941925 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-02129357-35d3-4dde-a9c1-bbf937965549 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b991f5024e4b5dbe8510b7381b1dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f871b0e1d3154b6d8c297b12ae738be0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:04.030950 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-02129357-35d3-4dde-a9c1-bbf937965549 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] 10.222.0.25 "GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7" status: 200 len: 1219 microversion: 2.1 time: 0.811982 Sep 01 14:06:04.035472 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 14/26] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:03 2022] GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7 => generated 1219 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:05.075220 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-7c8ca6fa-91eb-422c-a023-d3cf63db46da tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:05.076336 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-7c8ca6fa-91eb-422c-a023-d3cf63db46da tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] [instance: 3000b992-fcbf-472e-a1e0-11b101af43a7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:05.151065 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7c8ca6fa-91eb-422c-a023-d3cf63db46da tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:05.151471 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7c8ca6fa-91eb-422c-a023-d3cf63db46da tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:05.151921 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7c8ca6fa-91eb-422c-a023-d3cf63db46da tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:05.156745 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7c8ca6fa-91eb-422c-a023-d3cf63db46da tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:05.159280 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7c8ca6fa-91eb-422c-a023-d3cf63db46da tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:05.159840 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7c8ca6fa-91eb-422c-a023-d3cf63db46da tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:05.794837 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-7c8ca6fa-91eb-422c-a023-d3cf63db46da tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b991f5024e4b5dbe8510b7381b1dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f871b0e1d3154b6d8c297b12ae738be0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:05.831155 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-7c8ca6fa-91eb-422c-a023-d3cf63db46da tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] 10.222.0.25 "GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7" status: 200 len: 1267 microversion: 2.1 time: 0.765185 Sep 01 14:06:05.844525 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 13/27] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:05 2022] GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7 => generated 1267 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:06.859055 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-d4cef6be-36cb-4d3c-848f-a89b155b82f8 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:06.860244 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-d4cef6be-36cb-4d3c-848f-a89b155b82f8 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] [instance: 3000b992-fcbf-472e-a1e0-11b101af43a7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:06.916942 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d4cef6be-36cb-4d3c-848f-a89b155b82f8 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:06.917986 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d4cef6be-36cb-4d3c-848f-a89b155b82f8 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:06.918768 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d4cef6be-36cb-4d3c-848f-a89b155b82f8 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:06.930249 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d4cef6be-36cb-4d3c-848f-a89b155b82f8 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:06.931135 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d4cef6be-36cb-4d3c-848f-a89b155b82f8 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:06.931980 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d4cef6be-36cb-4d3c-848f-a89b155b82f8 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:07.060129 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-0db9da7a-3398-43cb-a948-4b210b583a8d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1011099418", "imageRef": "9be77128-e763-4225-b76f-85fbb04ad9b2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:06:07.241867 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-d4cef6be-36cb-4d3c-848f-a89b155b82f8 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b991f5024e4b5dbe8510b7381b1dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f871b0e1d3154b6d8c297b12ae738be0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:07.253114 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-d4cef6be-36cb-4d3c-848f-a89b155b82f8 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] 10.222.0.25 "GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7" status: 200 len: 1273 microversion: 2.1 time: 0.401329 Sep 01 14:06:07.254385 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 14/28] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:06 2022] GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7 => generated 1273 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:07.678458 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.network.neutron [None req-0db9da7a-3398-43cb-a948-4b210b583a8d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] validate_networks() for [('9cdd4113-f7e0-45eb-bbb2-5da93102bf6c', None, None, None, None, None)] {{(pid=121339) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:06:08.035902 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-4fa34cfe-d06c-45c9-8d09-a608db37f573 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1720294611", "imageRef": "9be77128-e763-4225-b76f-85fbb04ad9b2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "04671c53-ca48-4ca5-8247-463b6ac1fbe1"}], "security_groups": [{"name": "tempest-securitygroup--1825152607"}], "key_name": "tempest-keypair-1128071397", "user_data": "}} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:06:08.057961 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell0:SELECT=2 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:08.913732 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.network.neutron [None req-4fa34cfe-d06c-45c9-8d09-a608db37f573 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] validate_networks() for [('04671c53-ca48-4ca5-8247-463b6ac1fbe1', None, None, None, None, None)] {{(pid=121340) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:06:12.241724 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell0:SELECT=6 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:12.241724 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.virt.hardware [None req-0db9da7a-3398-43cb-a948-4b210b583a8d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Flavor limits 0:0:0 {{(pid=121339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:06:12.261534 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.virt.hardware [None req-0db9da7a-3398-43cb-a948-4b210b583a8d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Image limits 0:0:0 {{(pid=121339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:06:12.261534 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.virt.hardware [None req-0db9da7a-3398-43cb-a948-4b210b583a8d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Flavor pref 0:0:0 {{(pid=121339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:06:12.261534 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.virt.hardware [None req-0db9da7a-3398-43cb-a948-4b210b583a8d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Image pref 0:0:0 {{(pid=121339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:06:12.261534 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.virt.hardware [None req-0db9da7a-3398-43cb-a948-4b210b583a8d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:06:12.340366 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0db9da7a-3398-43cb-a948-4b210b583a8d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:12.340366 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0db9da7a-3398-43cb-a948-4b210b583a8d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:12.340366 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0db9da7a-3398-43cb-a948-4b210b583a8d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:12.340366 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0db9da7a-3398-43cb-a948-4b210b583a8d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:12.341597 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0db9da7a-3398-43cb-a948-4b210b583a8d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:12.341597 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0db9da7a-3398-43cb-a948-4b210b583a8d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:12.444998 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.quota [None req-0db9da7a-3398-43cb-a948-4b210b583a8d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Getting quotas for project 36049d2090b84443a3bf3bf00558379e. Resources: {'cores', 'instances', 'ram'} {{(pid=121339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:06:12.485334 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.quota [None req-0db9da7a-3398-43cb-a948-4b210b583a8d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Getting quotas for user 7562a0429fdf42948174b517b211884f and project 36049d2090b84443a3bf3bf00558379e. Resources: {'cores', 'instances', 'ram'} {{(pid=121339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:06:12.528339 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell0:SELECT=14 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:12.541612 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-0db9da7a-3398-43cb-a948-4b210b583a8d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Going to run 1 instances... {{(pid=121339) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:06:12.560215 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-0db9da7a-3398-43cb-a948-4b210b583a8d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 846e670d-c808-44d5-be0e-9c36671fbe91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9be77128-e763-4225-b76f-85fbb04ad9b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:06:12.618136 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-4fa34cfe-d06c-45c9-8d09-a608db37f573 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Flavor limits 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:06:12.619120 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-4fa34cfe-d06c-45c9-8d09-a608db37f573 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Image limits 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:06:12.620004 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-4fa34cfe-d06c-45c9-8d09-a608db37f573 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Flavor pref 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:06:12.620800 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-4fa34cfe-d06c-45c9-8d09-a608db37f573 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Image pref 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:06:12.621538 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-4fa34cfe-d06c-45c9-8d09-a608db37f573 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:06:12.636845 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4fa34cfe-d06c-45c9-8d09-a608db37f573 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:12.637845 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4fa34cfe-d06c-45c9-8d09-a608db37f573 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:12.639198 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4fa34cfe-d06c-45c9-8d09-a608db37f573 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:12.640659 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4fa34cfe-d06c-45c9-8d09-a608db37f573 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:12.641461 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4fa34cfe-d06c-45c9-8d09-a608db37f573 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:12.643576 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4fa34cfe-d06c-45c9-8d09-a608db37f573 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:12.687792 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.quota [None req-4fa34cfe-d06c-45c9-8d09-a608db37f573 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Getting quotas for project 3ed58deb61194a5ba3f2d46eb7e5680c. Resources: {'cores', 'instances', 'ram'} {{(pid=121340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:06:12.696992 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.quota [None req-4fa34cfe-d06c-45c9-8d09-a608db37f573 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Getting quotas for user 61401557e7624580b20de6e31c92f785 and project 3ed58deb61194a5ba3f2d46eb7e5680c. Resources: {'cores', 'instances', 'ram'} {{(pid=121340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:06:12.716832 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-4fa34cfe-d06c-45c9-8d09-a608db37f573 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Going to run 1 instances... {{(pid=121340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:06:12.721697 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-4fa34cfe-d06c-45c9-8d09-a608db37f573 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9be77128-e763-4225-b76f-85fbb04ad9b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:06:13.827590 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-4fa34cfe-d06c-45c9-8d09-a608db37f573 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 5.796466 Sep 01 14:06:13.843294 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 15/29] 10.222.0.25 () {62 vars in 1188 bytes} [Thu Sep 1 14:06:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 5815 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 01 14:06:13.868426 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-5ed351a2-6648-4f13-a2a8-f2eb104f15b0 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:13.870536 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-5ed351a2-6648-4f13-a2a8-f2eb104f15b0 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] [instance: 3000b992-fcbf-472e-a1e0-11b101af43a7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:13.874054 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-0db9da7a-3398-43cb-a948-4b210b583a8d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 7.886337 Sep 01 14:06:13.874692 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 15/30] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 1 14:06:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 7888 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 14:06:13.886662 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5ed351a2-6648-4f13-a2a8-f2eb104f15b0 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:13.888158 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5ed351a2-6648-4f13-a2a8-f2eb104f15b0 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:13.888839 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5ed351a2-6648-4f13-a2a8-f2eb104f15b0 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:13.889795 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5ed351a2-6648-4f13-a2a8-f2eb104f15b0 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:13.890498 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5ed351a2-6648-4f13-a2a8-f2eb104f15b0 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:13.891269 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5ed351a2-6648-4f13-a2a8-f2eb104f15b0 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:13.919553 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-eff47c8e-7ade-4196-aa8d-07775d623013 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:13.920978 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-eff47c8e-7ade-4196-aa8d-07775d623013 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:14.745423 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-eff47c8e-7ade-4196-aa8d-07775d623013 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:14.773525 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-eff47c8e-7ade-4196-aa8d-07775d623013 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:14.787674 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-eff47c8e-7ade-4196-aa8d-07775d623013 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:14.815365 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-eff47c8e-7ade-4196-aa8d-07775d623013 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1282 microversion: 2.20 time: 0.939074 Sep 01 14:06:14.816386 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 16/31] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:06:13 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1282 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:06:14.852641 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-216769a7-32a8-4c50-8f52-030f5f999249 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:14.853873 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-216769a7-32a8-4c50-8f52-030f5f999249 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 846e670d-c808-44d5-be0e-9c36671fbe91] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:14.988964 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-5ed351a2-6648-4f13-a2a8-f2eb104f15b0 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b991f5024e4b5dbe8510b7381b1dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f871b0e1d3154b6d8c297b12ae738be0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:15.003849 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-5ed351a2-6648-4f13-a2a8-f2eb104f15b0 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] 10.222.0.25 "GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7" status: 200 len: 1315 microversion: 2.1 time: 1.157481 Sep 01 14:06:15.004673 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 16/32] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:13 2022] GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7 => generated 1315 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:15.121113 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-216769a7-32a8-4c50-8f52-030f5f999249 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:15.156138 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-216769a7-32a8-4c50-8f52-030f5f999249 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91" status: 200 len: 1222 microversion: 2.1 time: 0.333518 Sep 01 14:06:15.178322 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 17/33] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:14 2022] GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91 => generated 1222 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:15.520543 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-17347a49-eddc-4932-a8d9-d359ac3664d1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-613326527", "imageRef": "9be77128-e763-4225-b76f-85fbb04ad9b2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:06:15.738755 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.network.neutron [None req-17347a49-eddc-4932-a8d9-d359ac3664d1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] validate_networks() for [('9cdd4113-f7e0-45eb-bbb2-5da93102bf6c', None, None, None, None, None)] {{(pid=121340) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:06:15.842655 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-6bebae25-eddb-49b8-a887-57dfdc687807 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:15.843678 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-6bebae25-eddb-49b8-a887-57dfdc687807 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:16.830493 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-6bebae25-eddb-49b8-a887-57dfdc687807 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:16.860385 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-6bebae25-eddb-49b8-a887-57dfdc687807 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:16.864379 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-6bebae25-eddb-49b8-a887-57dfdc687807 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:16.869887 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-6bebae25-eddb-49b8-a887-57dfdc687807 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1282 microversion: 2.20 time: 1.030192 Sep 01 14:06:16.873068 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 18/34] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:06:15 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1282 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:06:16.879663 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-3fb73e6b-cfdb-4fd1-950a-09710a6ac570 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:16.880699 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-3fb73e6b-cfdb-4fd1-950a-09710a6ac570 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] [instance: 3000b992-fcbf-472e-a1e0-11b101af43a7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:16.903852 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3fb73e6b-cfdb-4fd1-950a-09710a6ac570 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:16.904881 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3fb73e6b-cfdb-4fd1-950a-09710a6ac570 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:16.907076 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3fb73e6b-cfdb-4fd1-950a-09710a6ac570 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:16.915067 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3fb73e6b-cfdb-4fd1-950a-09710a6ac570 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:16.917761 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3fb73e6b-cfdb-4fd1-950a-09710a6ac570 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:16.925532 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3fb73e6b-cfdb-4fd1-950a-09710a6ac570 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:18.281379 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-3fb73e6b-cfdb-4fd1-950a-09710a6ac570 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b991f5024e4b5dbe8510b7381b1dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f871b0e1d3154b6d8c297b12ae738be0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:18.325726 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-3fb73e6b-cfdb-4fd1-950a-09710a6ac570 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] 10.222.0.25 "GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7" status: 200 len: 1315 microversion: 2.1 time: 1.442315 Sep 01 14:06:18.327271 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 19/35] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:16 2022] GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7 => generated 1315 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:18.541083 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-17347a49-eddc-4932-a8d9-d359ac3664d1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Flavor limits 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:06:18.542690 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-17347a49-eddc-4932-a8d9-d359ac3664d1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Image limits 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:06:18.543514 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-17347a49-eddc-4932-a8d9-d359ac3664d1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Flavor pref 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:06:18.544165 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-17347a49-eddc-4932-a8d9-d359ac3664d1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Image pref 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:06:18.544784 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-17347a49-eddc-4932-a8d9-d359ac3664d1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:06:18.559804 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-17347a49-eddc-4932-a8d9-d359ac3664d1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:18.563001 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-17347a49-eddc-4932-a8d9-d359ac3664d1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:18.567277 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-17347a49-eddc-4932-a8d9-d359ac3664d1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:18.568553 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-17347a49-eddc-4932-a8d9-d359ac3664d1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:18.569850 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-17347a49-eddc-4932-a8d9-d359ac3664d1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:18.577673 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-17347a49-eddc-4932-a8d9-d359ac3664d1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:18.683498 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.quota [None req-17347a49-eddc-4932-a8d9-d359ac3664d1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Getting quotas for project 36049d2090b84443a3bf3bf00558379e. Resources: {'cores', 'instances', 'ram'} {{(pid=121340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:06:18.711532 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.quota [None req-17347a49-eddc-4932-a8d9-d359ac3664d1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Getting quotas for user 7562a0429fdf42948174b517b211884f and project 36049d2090b84443a3bf3bf00558379e. Resources: {'cores', 'instances', 'ram'} {{(pid=121340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:06:18.729227 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-17347a49-eddc-4932-a8d9-d359ac3664d1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Going to run 1 instances... {{(pid=121340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:06:18.732204 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-17347a49-eddc-4932-a8d9-d359ac3664d1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9be77128-e763-4225-b76f-85fbb04ad9b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:06:18.856447 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [req-c7aa9f47-2b26-4572-b11e-9884c53f4ddd req-839ecd36-5578-43ca-9688-857072db780d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3000b992-fcbf-472e-a1e0-11b101af43a7", "tag": "c244d57b-8a64-435a-8910-dd80fa1b3bd5"}]} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:06:18.943795 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-c7aa9f47-2b26-4572-b11e-9884c53f4ddd req-839ecd36-5578-43ca-9688-857072db780d service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:18.944283 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-c7aa9f47-2b26-4572-b11e-9884c53f4ddd req-839ecd36-5578-43ca-9688-857072db780d service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:18.954206 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-17347a49-eddc-4932-a8d9-d359ac3664d1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.438781 Sep 01 14:06:18.956246 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 17/36] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 1 14:06:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 3442 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 14:06:18.958418 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-c7aa9f47-2b26-4572-b11e-9884c53f4ddd req-839ecd36-5578-43ca-9688-857072db780d service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:19.007044 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-711e8161-223c-444b-9f1c-4d94bb726e7b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:19.013755 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-711e8161-223c-444b-9f1c-4d94bb726e7b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:19.036180 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-711e8161-223c-444b-9f1c-4d94bb726e7b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:19.036821 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-711e8161-223c-444b-9f1c-4d94bb726e7b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:19.037298 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-711e8161-223c-444b-9f1c-4d94bb726e7b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:19.045363 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-711e8161-223c-444b-9f1c-4d94bb726e7b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:19.055063 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-711e8161-223c-444b-9f1c-4d94bb726e7b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:19.056320 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-711e8161-223c-444b-9f1c-4d94bb726e7b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:19.103380 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.compute.server_external_events [req-c7aa9f47-2b26-4572-b11e-9884c53f4ddd req-839ecd36-5578-43ca-9688-857072db780d service nova] Creating event network-changed:c244d57b-8a64-435a-8910-dd80fa1b3bd5 for instance 3000b992-fcbf-472e-a1e0-11b101af43a7 on hv-cinder-85221 Sep 01 14:06:19.106409 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-c7aa9f47-2b26-4572-b11e-9884c53f4ddd req-839ecd36-5578-43ca-9688-857072db780d service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121339) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 01 14:06:19.107214 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-c7aa9f47-2b26-4572-b11e-9884c53f4ddd req-839ecd36-5578-43ca-9688-857072db780d service nova] Acquired lock "compute-rpcapi-router" {{(pid=121339) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 01 14:06:19.109118 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8209d2dd-c7f5-4850-8886-165254150d3f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:19.109946 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8209d2dd-c7f5-4850-8886-165254150d3f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:19.124273 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8209d2dd-c7f5-4850-8886-165254150d3f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:19.125553 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8209d2dd-c7f5-4850-8886-165254150d3f None None] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:19.127708 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8209d2dd-c7f5-4850-8886-165254150d3f None None] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:19.130203 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8209d2dd-c7f5-4850-8886-165254150d3f None None] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:19.192219 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.compute.rpcapi [None req-8209d2dd-c7f5-4850-8886-165254150d3f None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 01 14:06:19.196748 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8209d2dd-c7f5-4850-8886-165254150d3f None None] Releasing lock "compute-rpcapi-router" {{(pid=121339) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 01 14:06:19.274020 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-8209d2dd-c7f5-4850-8886-165254150d3f None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.921648 Sep 01 14:06:19.280408 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 20/37] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:06:19.303710 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-37055684-ec19-4cad-b814-17ba4ced4903 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2064835210", "imageRef": "9be77128-e763-4225-b76f-85fbb04ad9b2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5efdbb74-e6fe-4a11-96cb-23855066e81b"}], "security_groups": [{"name": "tempest-securitygroup--1477163944"}], "key_name": "tempest-keypair-622888630", "user_data": "}} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:06:19.510485 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-711e8161-223c-444b-9f1c-4d94bb726e7b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:19.554928 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-711e8161-223c-444b-9f1c-4d94bb726e7b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:19.573639 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-711e8161-223c-444b-9f1c-4d94bb726e7b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:19.585953 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-711e8161-223c-444b-9f1c-4d94bb726e7b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1334 microversion: 2.20 time: 0.621004 Sep 01 14:06:19.588632 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 18/38] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:06:18 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1334 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:06:19.603032 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-7bad13d9-6d3b-4eb2-bbd8-2898f221f998 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:19.604766 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-7bad13d9-6d3b-4eb2-bbd8-2898f221f998 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:19.872678 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.network.neutron [None req-37055684-ec19-4cad-b814-17ba4ced4903 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] validate_networks() for [('5efdbb74-e6fe-4a11-96cb-23855066e81b', None, None, None, None, None)] {{(pid=121339) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:06:20.348845 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-7bad13d9-6d3b-4eb2-bbd8-2898f221f998 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:20.468653 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-7bad13d9-6d3b-4eb2-bbd8-2898f221f998 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1221 microversion: 2.1 time: 0.877313 Sep 01 14:06:20.487855 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 19/39] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:19 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1221 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:20.515063 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-1940321b-1752-4cfe-972e-065329014e21 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:20.517922 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-1940321b-1752-4cfe-972e-065329014e21 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] [instance: 3000b992-fcbf-472e-a1e0-11b101af43a7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:20.534258 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1940321b-1752-4cfe-972e-065329014e21 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:20.536220 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1940321b-1752-4cfe-972e-065329014e21 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:20.537720 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1940321b-1752-4cfe-972e-065329014e21 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:20.540159 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1940321b-1752-4cfe-972e-065329014e21 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:20.543267 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1940321b-1752-4cfe-972e-065329014e21 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:20.544552 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1940321b-1752-4cfe-972e-065329014e21 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:21.243355 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-1940321b-1752-4cfe-972e-065329014e21 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b991f5024e4b5dbe8510b7381b1dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f871b0e1d3154b6d8c297b12ae738be0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:21.258939 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-1940321b-1752-4cfe-972e-065329014e21 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] 10.222.0.25 "GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7" status: 200 len: 1315 microversion: 2.1 time: 0.768785 Sep 01 14:06:21.261225 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 20/40] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:20 2022] GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7 => generated 1315 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:21.302737 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-e883997b-7d67-418a-85e9-94d3eb9839ab tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:21.303445 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-e883997b-7d67-418a-85e9-94d3eb9839ab tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:21.338759 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e883997b-7d67-418a-85e9-94d3eb9839ab tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:21.339257 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e883997b-7d67-418a-85e9-94d3eb9839ab tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:21.339702 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e883997b-7d67-418a-85e9-94d3eb9839ab tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:21.355620 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e883997b-7d67-418a-85e9-94d3eb9839ab tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:21.356213 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e883997b-7d67-418a-85e9-94d3eb9839ab tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:21.361973 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e883997b-7d67-418a-85e9-94d3eb9839ab tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:21.777161 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-e883997b-7d67-418a-85e9-94d3eb9839ab tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:21.780848 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell1:SELECT=41 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:21.796498 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-e883997b-7d67-418a-85e9-94d3eb9839ab tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:21.799520 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-e883997b-7d67-418a-85e9-94d3eb9839ab tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:21.805189 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-e883997b-7d67-418a-85e9-94d3eb9839ab tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1340 microversion: 2.20 time: 0.528447 Sep 01 14:06:21.806012 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 21/41] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:06:21 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1340 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:06:21.811886 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-c179f15c-0dac-4e17-96c8-933e1fe3b9e3 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:21.812861 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-c179f15c-0dac-4e17-96c8-933e1fe3b9e3 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:21.817026 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=11 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:21.821526 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c179f15c-0dac-4e17-96c8-933e1fe3b9e3 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:21.822258 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c179f15c-0dac-4e17-96c8-933e1fe3b9e3 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:21.822866 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c179f15c-0dac-4e17-96c8-933e1fe3b9e3 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:21.824008 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c179f15c-0dac-4e17-96c8-933e1fe3b9e3 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:21.824702 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c179f15c-0dac-4e17-96c8-933e1fe3b9e3 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:21.825358 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c179f15c-0dac-4e17-96c8-933e1fe3b9e3 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:22.114950 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-c179f15c-0dac-4e17-96c8-933e1fe3b9e3 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:22.147261 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-c179f15c-0dac-4e17-96c8-933e1fe3b9e3 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1225 microversion: 2.1 time: 0.333964 Sep 01 14:06:22.151746 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 22/42] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:21 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1225 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:22.289737 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-a1fac35b-e748-494e-995b-62e85002dd55 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:22.292443 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-a1fac35b-e748-494e-995b-62e85002dd55 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] [instance: 3000b992-fcbf-472e-a1e0-11b101af43a7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:22.309399 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a1fac35b-e748-494e-995b-62e85002dd55 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:22.311577 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a1fac35b-e748-494e-995b-62e85002dd55 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:22.312733 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a1fac35b-e748-494e-995b-62e85002dd55 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:22.315121 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a1fac35b-e748-494e-995b-62e85002dd55 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:22.316380 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a1fac35b-e748-494e-995b-62e85002dd55 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:22.317216 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a1fac35b-e748-494e-995b-62e85002dd55 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:22.804802 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-a1fac35b-e748-494e-995b-62e85002dd55 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b991f5024e4b5dbe8510b7381b1dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f871b0e1d3154b6d8c297b12ae738be0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:22.813487 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-a1fac35b-e748-494e-995b-62e85002dd55 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] 10.222.0.25 "GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7" status: 200 len: 1315 microversion: 2.1 time: 0.533024 Sep 01 14:06:22.822847 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 23/43] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:22 2022] GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7 => generated 1315 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:22.850259 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-79ae5848-2ac3-4831-9369-16e84280cf60 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:22.850894 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-79ae5848-2ac3-4831-9369-16e84280cf60 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:22.868840 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-79ae5848-2ac3-4831-9369-16e84280cf60 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:22.873808 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-79ae5848-2ac3-4831-9369-16e84280cf60 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:22.874617 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-79ae5848-2ac3-4831-9369-16e84280cf60 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:22.877397 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-79ae5848-2ac3-4831-9369-16e84280cf60 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:22.877884 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-79ae5848-2ac3-4831-9369-16e84280cf60 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:22.878348 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-79ae5848-2ac3-4831-9369-16e84280cf60 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:23.165437 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-79ae5848-2ac3-4831-9369-16e84280cf60 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:23.184981 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-79ae5848-2ac3-4831-9369-16e84280cf60 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:23.188627 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-79ae5848-2ac3-4831-9369-16e84280cf60 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:23.192067 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-79ae5848-2ac3-4831-9369-16e84280cf60 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1340 microversion: 2.20 time: 0.346607 Sep 01 14:06:23.193685 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 24/44] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:06:22 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1340 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:06:23.210634 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-84e52bfe-71d3-4617-abce-791d5f79aabe tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:23.210634 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-84e52bfe-71d3-4617-abce-791d5f79aabe tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:23.222110 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-84e52bfe-71d3-4617-abce-791d5f79aabe tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:23.223449 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-84e52bfe-71d3-4617-abce-791d5f79aabe tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:23.224318 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-84e52bfe-71d3-4617-abce-791d5f79aabe tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:23.226880 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-84e52bfe-71d3-4617-abce-791d5f79aabe tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:23.227838 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-84e52bfe-71d3-4617-abce-791d5f79aabe tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:23.228606 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-84e52bfe-71d3-4617-abce-791d5f79aabe tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:23.296240 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.virt.hardware [None req-37055684-ec19-4cad-b814-17ba4ced4903 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Flavor limits 0:0:0 {{(pid=121339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:06:23.296850 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.virt.hardware [None req-37055684-ec19-4cad-b814-17ba4ced4903 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Image limits 0:0:0 {{(pid=121339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:06:23.297885 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.virt.hardware [None req-37055684-ec19-4cad-b814-17ba4ced4903 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Flavor pref 0:0:0 {{(pid=121339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:06:23.298772 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.virt.hardware [None req-37055684-ec19-4cad-b814-17ba4ced4903 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Image pref 0:0:0 {{(pid=121339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:06:23.299692 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.virt.hardware [None req-37055684-ec19-4cad-b814-17ba4ced4903 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:06:23.322010 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-37055684-ec19-4cad-b814-17ba4ced4903 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:23.323608 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-37055684-ec19-4cad-b814-17ba4ced4903 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:23.325057 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-37055684-ec19-4cad-b814-17ba4ced4903 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:23.327148 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-37055684-ec19-4cad-b814-17ba4ced4903 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:23.328748 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-37055684-ec19-4cad-b814-17ba4ced4903 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:23.330314 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-37055684-ec19-4cad-b814-17ba4ced4903 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:23.365484 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-84e52bfe-71d3-4617-abce-791d5f79aabe tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:23.371223 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.quota [None req-37055684-ec19-4cad-b814-17ba4ced4903 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Getting quotas for project eaba67e3a54f4191b9b924305a83e4eb. Resources: {'cores', 'instances', 'ram'} {{(pid=121339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:06:23.379934 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.quota [None req-37055684-ec19-4cad-b814-17ba4ced4903 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Getting quotas for user ff664c7ba095413daad6b3f1ebc49cc0 and project eaba67e3a54f4191b9b924305a83e4eb. Resources: {'cores', 'instances', 'ram'} {{(pid=121339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:06:23.398938 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-84e52bfe-71d3-4617-abce-791d5f79aabe tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1273 microversion: 2.1 time: 0.197210 Sep 01 14:06:23.398938 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 25/45] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:23 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1273 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:23.407378 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-37055684-ec19-4cad-b814-17ba4ced4903 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Going to run 1 instances... {{(pid=121339) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:06:23.413189 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-37055684-ec19-4cad-b814-17ba4ced4903 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9be77128-e763-4225-b76f-85fbb04ad9b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:06:23.707110 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-37055684-ec19-4cad-b814-17ba4ced4903 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.418027 Sep 01 14:06:23.710289 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 21/46] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 1 14:06:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 4422 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 14:06:23.734640 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-378389aa-ceb3-4707-995f-6a57eb514f38 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:23.738453 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-378389aa-ceb3-4707-995f-6a57eb514f38 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:23.870821 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-e157fab2-776b-409d-aaf0-276256470033 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:23.871450 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-e157fab2-776b-409d-aaf0-276256470033 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] [instance: 3000b992-fcbf-472e-a1e0-11b101af43a7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:23.885676 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e157fab2-776b-409d-aaf0-276256470033 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:23.886212 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e157fab2-776b-409d-aaf0-276256470033 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:23.886655 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e157fab2-776b-409d-aaf0-276256470033 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:23.887383 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e157fab2-776b-409d-aaf0-276256470033 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:23.892010 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e157fab2-776b-409d-aaf0-276256470033 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:23.892812 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e157fab2-776b-409d-aaf0-276256470033 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:24.275107 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-378389aa-ceb3-4707-995f-6a57eb514f38 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:24.304248 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-378389aa-ceb3-4707-995f-6a57eb514f38 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1237 microversion: 2.1 time: 0.583998 Sep 01 14:06:24.315465 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 26/47] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:23 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1237 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:24.322041 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-c3568936-90f1-4358-be97-a37ee09af1c2 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:24.322383 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-c3568936-90f1-4358-be97-a37ee09af1c2 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:24.342982 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c3568936-90f1-4358-be97-a37ee09af1c2 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:24.347967 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c3568936-90f1-4358-be97-a37ee09af1c2 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:24.348421 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c3568936-90f1-4358-be97-a37ee09af1c2 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:24.349356 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c3568936-90f1-4358-be97-a37ee09af1c2 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:24.350103 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c3568936-90f1-4358-be97-a37ee09af1c2 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:24.352458 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c3568936-90f1-4358-be97-a37ee09af1c2 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:24.778945 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-c3568936-90f1-4358-be97-a37ee09af1c2 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:24.795087 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-c3568936-90f1-4358-be97-a37ee09af1c2 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:24.796995 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-c3568936-90f1-4358-be97-a37ee09af1c2 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:24.801290 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-c3568936-90f1-4358-be97-a37ee09af1c2 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1408 microversion: 2.20 time: 0.484656 Sep 01 14:06:24.808888 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-e157fab2-776b-409d-aaf0-276256470033 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b991f5024e4b5dbe8510b7381b1dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f871b0e1d3154b6d8c297b12ae738be0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:24.813932 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 27/48] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:06:24 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1408 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:06:24.820996 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-e157fab2-776b-409d-aaf0-276256470033 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] 10.222.0.25 "GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7" status: 200 len: 1315 microversion: 2.1 time: 0.954237 Sep 01 14:06:24.824915 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-ff9dea6e-89d7-4a56-87ba-ac8f7e604867 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:24.833634 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-ff9dea6e-89d7-4a56-87ba-ac8f7e604867 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:24.854613 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 22/49] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:23 2022] GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7 => generated 1315 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:06:24.854995 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ff9dea6e-89d7-4a56-87ba-ac8f7e604867 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:24.855618 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ff9dea6e-89d7-4a56-87ba-ac8f7e604867 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:24.856072 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ff9dea6e-89d7-4a56-87ba-ac8f7e604867 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:24.856986 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ff9dea6e-89d7-4a56-87ba-ac8f7e604867 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:24.857293 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ff9dea6e-89d7-4a56-87ba-ac8f7e604867 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:24.857951 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ff9dea6e-89d7-4a56-87ba-ac8f7e604867 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:24.957525 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-ff9dea6e-89d7-4a56-87ba-ac8f7e604867 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:24.966681 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-ff9dea6e-89d7-4a56-87ba-ac8f7e604867 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1273 microversion: 2.1 time: 0.149066 Sep 01 14:06:24.967603 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 28/50] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:24 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1273 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:25.345520 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-d789d67b-6372-4702-9031-b91f90cb635c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:25.347967 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-d789d67b-6372-4702-9031-b91f90cb635c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:25.467356 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-d789d67b-6372-4702-9031-b91f90cb635c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:25.505191 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-d789d67b-6372-4702-9031-b91f90cb635c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1237 microversion: 2.1 time: 0.164547 Sep 01 14:06:25.506363 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 23/51] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:25 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1237 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:25.856523 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-261ffe1f-c8c0-4a46-be4d-8f7e158bc596 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:25.857928 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-261ffe1f-c8c0-4a46-be4d-8f7e158bc596 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] [instance: 3000b992-fcbf-472e-a1e0-11b101af43a7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:25.862496 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-1c5e61f0-45a4-41fd-a082-bba933c61978 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:25.863296 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-1c5e61f0-45a4-41fd-a082-bba933c61978 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:25.872408 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-261ffe1f-c8c0-4a46-be4d-8f7e158bc596 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:25.873839 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-261ffe1f-c8c0-4a46-be4d-8f7e158bc596 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:25.873839 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-261ffe1f-c8c0-4a46-be4d-8f7e158bc596 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:25.874866 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-261ffe1f-c8c0-4a46-be4d-8f7e158bc596 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:25.875548 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-261ffe1f-c8c0-4a46-be4d-8f7e158bc596 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:25.876187 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-261ffe1f-c8c0-4a46-be4d-8f7e158bc596 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:25.878170 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1c5e61f0-45a4-41fd-a082-bba933c61978 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:25.878812 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1c5e61f0-45a4-41fd-a082-bba933c61978 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:25.881175 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1c5e61f0-45a4-41fd-a082-bba933c61978 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:25.885797 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1c5e61f0-45a4-41fd-a082-bba933c61978 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:25.886648 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1c5e61f0-45a4-41fd-a082-bba933c61978 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:25.887412 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1c5e61f0-45a4-41fd-a082-bba933c61978 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:26.290917 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-261ffe1f-c8c0-4a46-be4d-8f7e158bc596 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b991f5024e4b5dbe8510b7381b1dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f871b0e1d3154b6d8c297b12ae738be0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:26.307715 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-261ffe1f-c8c0-4a46-be4d-8f7e158bc596 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] 10.222.0.25 "GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7" status: 200 len: 1315 microversion: 2.1 time: 0.461336 Sep 01 14:06:26.321425 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 29/52] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:25 2022] GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7 => generated 1315 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:26.327490 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-4af84fcc-f709-4f9b-b484-fde229f0d003 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:26.328128 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-4af84fcc-f709-4f9b-b484-fde229f0d003 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:26.345643 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4af84fcc-f709-4f9b-b484-fde229f0d003 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:26.346316 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4af84fcc-f709-4f9b-b484-fde229f0d003 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:26.346785 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4af84fcc-f709-4f9b-b484-fde229f0d003 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:26.357517 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4af84fcc-f709-4f9b-b484-fde229f0d003 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:26.358581 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4af84fcc-f709-4f9b-b484-fde229f0d003 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:26.359318 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4af84fcc-f709-4f9b-b484-fde229f0d003 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:26.425268 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-1c5e61f0-45a4-41fd-a082-bba933c61978 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:26.435275 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-1c5e61f0-45a4-41fd-a082-bba933c61978 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:26.442341 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-1c5e61f0-45a4-41fd-a082-bba933c61978 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:26.449319 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-1c5e61f0-45a4-41fd-a082-bba933c61978 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1408 microversion: 2.20 time: 0.586649 Sep 01 14:06:26.449319 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 24/53] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:06:25 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1408 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:06:26.530400 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-ef860ed3-9b4e-424d-b95f-612760d4df85 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:26.530400 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-ef860ed3-9b4e-424d-b95f-612760d4df85 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:26.541439 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ef860ed3-9b4e-424d-b95f-612760d4df85 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:26.543201 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ef860ed3-9b4e-424d-b95f-612760d4df85 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:26.543837 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ef860ed3-9b4e-424d-b95f-612760d4df85 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:26.545128 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ef860ed3-9b4e-424d-b95f-612760d4df85 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:26.547084 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ef860ed3-9b4e-424d-b95f-612760d4df85 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:26.549932 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ef860ed3-9b4e-424d-b95f-612760d4df85 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:26.551177 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-4af84fcc-f709-4f9b-b484-fde229f0d003 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:26.564997 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-4af84fcc-f709-4f9b-b484-fde229f0d003 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1273 microversion: 2.1 time: 0.241894 Sep 01 14:06:26.583176 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 30/54] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:26 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1273 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:26.753674 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-ef860ed3-9b4e-424d-b95f-612760d4df85 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:26.764525 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-ef860ed3-9b4e-424d-b95f-612760d4df85 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1241 microversion: 2.1 time: 0.240344 Sep 01 14:06:26.765124 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 25/55] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:26 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1241 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:06:27.336269 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-52b6863e-217e-46fe-ae36-7f58d042e78b tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:27.337694 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-52b6863e-217e-46fe-ae36-7f58d042e78b tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] [instance: 3000b992-fcbf-472e-a1e0-11b101af43a7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:27.345430 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-52b6863e-217e-46fe-ae36-7f58d042e78b tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:27.346396 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-52b6863e-217e-46fe-ae36-7f58d042e78b tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:27.347325 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-52b6863e-217e-46fe-ae36-7f58d042e78b tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:27.348518 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-52b6863e-217e-46fe-ae36-7f58d042e78b tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:27.349190 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-52b6863e-217e-46fe-ae36-7f58d042e78b tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:27.349835 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-52b6863e-217e-46fe-ae36-7f58d042e78b tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:27.477658 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-e4f02862-1bef-4b67-953c-ab873e68adcd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:27.478376 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-e4f02862-1bef-4b67-953c-ab873e68adcd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:27.502649 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e4f02862-1bef-4b67-953c-ab873e68adcd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:27.503185 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e4f02862-1bef-4b67-953c-ab873e68adcd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:27.506159 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e4f02862-1bef-4b67-953c-ab873e68adcd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:27.506992 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e4f02862-1bef-4b67-953c-ab873e68adcd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:27.507483 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e4f02862-1bef-4b67-953c-ab873e68adcd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:27.507923 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e4f02862-1bef-4b67-953c-ab873e68adcd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:27.958384 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-52b6863e-217e-46fe-ae36-7f58d042e78b tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b991f5024e4b5dbe8510b7381b1dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f871b0e1d3154b6d8c297b12ae738be0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:27.967442 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-52b6863e-217e-46fe-ae36-7f58d042e78b tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] 10.222.0.25 "GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7" status: 200 len: 1315 microversion: 2.1 time: 0.639538 Sep 01 14:06:27.968559 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 31/56] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:27 2022] GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7 => generated 1315 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:27.981112 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-d3ef24de-8cd2-4940-be75-a95646b1f50a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:27.982029 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-d3ef24de-8cd2-4940-be75-a95646b1f50a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:27.996107 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d3ef24de-8cd2-4940-be75-a95646b1f50a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:27.996601 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d3ef24de-8cd2-4940-be75-a95646b1f50a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:27.997032 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d3ef24de-8cd2-4940-be75-a95646b1f50a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:27.997735 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d3ef24de-8cd2-4940-be75-a95646b1f50a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:27.998215 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d3ef24de-8cd2-4940-be75-a95646b1f50a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:27.998634 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d3ef24de-8cd2-4940-be75-a95646b1f50a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:28.015687 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-e4f02862-1bef-4b67-953c-ab873e68adcd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:28.030276 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-e4f02862-1bef-4b67-953c-ab873e68adcd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:28.033638 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-e4f02862-1bef-4b67-953c-ab873e68adcd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:28.040514 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-e4f02862-1bef-4b67-953c-ab873e68adcd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1408 microversion: 2.20 time: 0.567417 Sep 01 14:06:28.042243 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 26/57] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:06:27 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1408 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:06:28.076377 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-5febae30-a329-4939-97bd-8ce697d2f604 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:28.078977 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-5febae30-a329-4939-97bd-8ce697d2f604 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:28.115760 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5febae30-a329-4939-97bd-8ce697d2f604 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:28.121086 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5febae30-a329-4939-97bd-8ce697d2f604 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:28.122173 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5febae30-a329-4939-97bd-8ce697d2f604 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:28.123826 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5febae30-a329-4939-97bd-8ce697d2f604 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:28.127642 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5febae30-a329-4939-97bd-8ce697d2f604 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:28.128614 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5febae30-a329-4939-97bd-8ce697d2f604 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:28.256085 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-d3ef24de-8cd2-4940-be75-a95646b1f50a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:28.287461 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-d3ef24de-8cd2-4940-be75-a95646b1f50a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1273 microversion: 2.1 time: 0.314445 Sep 01 14:06:28.288501 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 32/58] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:27 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1273 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:28.316434 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [req-aa777e1f-6473-4d4c-8198-eede6f954324 req-1056851f-3618-43c9-b0a9-9d0c1f2f5af7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d39f7090-b419-46be-9fcc-7ae73004ab71", "tag": "9ae4ab09-714c-4175-ba0d-7b76b31e652d"}]} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:06:28.340143 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-5febae30-a329-4939-97bd-8ce697d2f604 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:28.361955 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-5febae30-a329-4939-97bd-8ce697d2f604 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1241 microversion: 2.1 time: 0.317826 Sep 01 14:06:28.363586 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 27/59] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:28 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1241 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:28.365352 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-aa777e1f-6473-4d4c-8198-eede6f954324 req-1056851f-3618-43c9-b0a9-9d0c1f2f5af7 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:28.366173 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-aa777e1f-6473-4d4c-8198-eede6f954324 req-1056851f-3618-43c9-b0a9-9d0c1f2f5af7 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:28.366674 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-aa777e1f-6473-4d4c-8198-eede6f954324 req-1056851f-3618-43c9-b0a9-9d0c1f2f5af7 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:28.388233 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.compute.server_external_events [req-aa777e1f-6473-4d4c-8198-eede6f954324 req-1056851f-3618-43c9-b0a9-9d0c1f2f5af7 service nova] Creating event network-changed:9ae4ab09-714c-4175-ba0d-7b76b31e652d for instance d39f7090-b419-46be-9fcc-7ae73004ab71 on hv-cinder-85221 Sep 01 14:06:28.388776 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-aa777e1f-6473-4d4c-8198-eede6f954324 req-1056851f-3618-43c9-b0a9-9d0c1f2f5af7 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121340) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 01 14:06:28.389158 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-aa777e1f-6473-4d4c-8198-eede6f954324 req-1056851f-3618-43c9-b0a9-9d0c1f2f5af7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121340) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 01 14:06:28.390534 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8bb8a8bb-3875-4ac0-b36e-28dbc2e3b4a9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:28.391199 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8bb8a8bb-3875-4ac0-b36e-28dbc2e3b4a9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:28.391629 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8bb8a8bb-3875-4ac0-b36e-28dbc2e3b4a9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:28.393046 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8bb8a8bb-3875-4ac0-b36e-28dbc2e3b4a9 None None] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:28.398188 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8bb8a8bb-3875-4ac0-b36e-28dbc2e3b4a9 None None] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:28.398188 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8bb8a8bb-3875-4ac0-b36e-28dbc2e3b4a9 None None] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:28.405230 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.compute.rpcapi [None req-8bb8a8bb-3875-4ac0-b36e-28dbc2e3b4a9 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 01 14:06:28.406130 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8bb8a8bb-3875-4ac0-b36e-28dbc2e3b4a9 None None] Releasing lock "compute-rpcapi-router" {{(pid=121340) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 01 14:06:28.435488 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-8bb8a8bb-3875-4ac0-b36e-28dbc2e3b4a9 None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142038 Sep 01 14:06:28.436096 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 33/60] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:06:28.636713 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [req-74afe797-a453-4a16-8942-825f4a0a86fe req-3c553a32-a3e8-4efc-be60-718eeaa35c62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "846e670d-c808-44d5-be0e-9c36671fbe91", "tag": "073b1d8b-8a54-4df8-a7c0-5ad23c885880"}]} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:06:28.643477 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=6 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:28.650388 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-74afe797-a453-4a16-8942-825f4a0a86fe req-3c553a32-a3e8-4efc-be60-718eeaa35c62 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:28.650846 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-74afe797-a453-4a16-8942-825f4a0a86fe req-3c553a32-a3e8-4efc-be60-718eeaa35c62 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:28.651810 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-74afe797-a453-4a16-8942-825f4a0a86fe req-3c553a32-a3e8-4efc-be60-718eeaa35c62 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:28.658417 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell1:SELECT=51 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:28.668946 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.compute.server_external_events [req-74afe797-a453-4a16-8942-825f4a0a86fe req-3c553a32-a3e8-4efc-be60-718eeaa35c62 service nova] Creating event network-changed:073b1d8b-8a54-4df8-a7c0-5ad23c885880 for instance 846e670d-c808-44d5-be0e-9c36671fbe91 on hv-cinder-85221 Sep 01 14:06:28.676721 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [req-74afe797-a453-4a16-8942-825f4a0a86fe req-3c553a32-a3e8-4efc-be60-718eeaa35c62 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.261784 Sep 01 14:06:28.677423 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 28/61] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:06:29.009239 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-6815287c-edbc-4aee-a867-5e128b1c2c3a tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:29.010723 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-6815287c-edbc-4aee-a867-5e128b1c2c3a tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] [instance: 3000b992-fcbf-472e-a1e0-11b101af43a7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:29.019191 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6815287c-edbc-4aee-a867-5e128b1c2c3a tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:29.019967 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6815287c-edbc-4aee-a867-5e128b1c2c3a tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:29.020556 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6815287c-edbc-4aee-a867-5e128b1c2c3a tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:29.021427 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6815287c-edbc-4aee-a867-5e128b1c2c3a tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:29.022744 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6815287c-edbc-4aee-a867-5e128b1c2c3a tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:29.023192 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6815287c-edbc-4aee-a867-5e128b1c2c3a tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:29.102959 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-788a9d3f-7c68-41ef-90b0-09834bf57690 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:29.104102 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-788a9d3f-7c68-41ef-90b0-09834bf57690 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:29.111777 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-788a9d3f-7c68-41ef-90b0-09834bf57690 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:29.112693 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-788a9d3f-7c68-41ef-90b0-09834bf57690 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:29.113337 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-788a9d3f-7c68-41ef-90b0-09834bf57690 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:29.114343 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-788a9d3f-7c68-41ef-90b0-09834bf57690 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:29.115041 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-788a9d3f-7c68-41ef-90b0-09834bf57690 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:29.115613 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-788a9d3f-7c68-41ef-90b0-09834bf57690 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:29.289351 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-6815287c-edbc-4aee-a867-5e128b1c2c3a tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b991f5024e4b5dbe8510b7381b1dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f871b0e1d3154b6d8c297b12ae738be0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:29.305341 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-6815287c-edbc-4aee-a867-5e128b1c2c3a tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] 10.222.0.25 "GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7" status: 200 len: 1315 microversion: 2.1 time: 0.303702 Sep 01 14:06:29.306981 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 34/62] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:28 2022] GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7 => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:29.333137 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-19b79406-9eca-489b-a305-6ff4378002d5 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:29.333991 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-19b79406-9eca-489b-a305-6ff4378002d5 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:29.346024 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-19b79406-9eca-489b-a305-6ff4378002d5 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:29.348533 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-19b79406-9eca-489b-a305-6ff4378002d5 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:29.348996 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-19b79406-9eca-489b-a305-6ff4378002d5 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:29.351009 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-19b79406-9eca-489b-a305-6ff4378002d5 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:29.351494 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-19b79406-9eca-489b-a305-6ff4378002d5 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:29.351932 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-19b79406-9eca-489b-a305-6ff4378002d5 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:29.372278 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-788a9d3f-7c68-41ef-90b0-09834bf57690 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:29.388501 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-788a9d3f-7c68-41ef-90b0-09834bf57690 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:29.392812 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-788a9d3f-7c68-41ef-90b0-09834bf57690 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:29.395881 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-788a9d3f-7c68-41ef-90b0-09834bf57690 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1408 microversion: 2.20 time: 0.296840 Sep 01 14:06:29.403552 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 29/63] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:06:29 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1408 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:06:29.410177 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-59cf5763-3ff5-4e38-aca1-1e23f3d9faab tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:29.416298 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-59cf5763-3ff5-4e38-aca1-1e23f3d9faab tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:29.437663 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-59cf5763-3ff5-4e38-aca1-1e23f3d9faab tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:29.443703 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-59cf5763-3ff5-4e38-aca1-1e23f3d9faab tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:29.443703 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-59cf5763-3ff5-4e38-aca1-1e23f3d9faab tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:29.443703 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-59cf5763-3ff5-4e38-aca1-1e23f3d9faab tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:29.443703 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-59cf5763-3ff5-4e38-aca1-1e23f3d9faab tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:29.444452 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-59cf5763-3ff5-4e38-aca1-1e23f3d9faab tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:29.468810 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-19b79406-9eca-489b-a305-6ff4378002d5 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:29.493729 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-19b79406-9eca-489b-a305-6ff4378002d5 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1273 microversion: 2.1 time: 0.166100 Sep 01 14:06:29.495008 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 35/64] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:29 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1273 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:29.605165 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-59cf5763-3ff5-4e38-aca1-1e23f3d9faab tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:29.628199 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-59cf5763-3ff5-4e38-aca1-1e23f3d9faab tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1289 microversion: 2.1 time: 0.220705 Sep 01 14:06:29.629407 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 30/65] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:29 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1289 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:30.340860 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-aca413b5-074b-4c84-bef3-4863ef7fdc5f tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:30.346462 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-aca413b5-074b-4c84-bef3-4863ef7fdc5f tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] [instance: 3000b992-fcbf-472e-a1e0-11b101af43a7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:30.369194 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-aca413b5-074b-4c84-bef3-4863ef7fdc5f tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:30.372926 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-aca413b5-074b-4c84-bef3-4863ef7fdc5f tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:30.377729 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-aca413b5-074b-4c84-bef3-4863ef7fdc5f tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:30.383061 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-aca413b5-074b-4c84-bef3-4863ef7fdc5f tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:30.385349 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-aca413b5-074b-4c84-bef3-4863ef7fdc5f tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:30.387617 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-aca413b5-074b-4c84-bef3-4863ef7fdc5f tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:30.433758 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-6f53c740-4f8e-42a2-8837-51f3a881d9e4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:30.435677 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-6f53c740-4f8e-42a2-8837-51f3a881d9e4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:30.476788 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6f53c740-4f8e-42a2-8837-51f3a881d9e4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:30.477886 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6f53c740-4f8e-42a2-8837-51f3a881d9e4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:30.478841 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6f53c740-4f8e-42a2-8837-51f3a881d9e4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:30.482585 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6f53c740-4f8e-42a2-8837-51f3a881d9e4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:30.486384 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6f53c740-4f8e-42a2-8837-51f3a881d9e4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:30.488836 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6f53c740-4f8e-42a2-8837-51f3a881d9e4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:31.310891 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-aca413b5-074b-4c84-bef3-4863ef7fdc5f tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b991f5024e4b5dbe8510b7381b1dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f871b0e1d3154b6d8c297b12ae738be0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:31.339101 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-6f53c740-4f8e-42a2-8837-51f3a881d9e4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:31.351739 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-6f53c740-4f8e-42a2-8837-51f3a881d9e4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:31.357685 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-aca413b5-074b-4c84-bef3-4863ef7fdc5f tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] 10.222.0.25 "GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7" status: 200 len: 1315 microversion: 2.1 time: 1.024456 Sep 01 14:06:31.358490 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-6f53c740-4f8e-42a2-8837-51f3a881d9e4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:31.360849 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-6f53c740-4f8e-42a2-8837-51f3a881d9e4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1408 microversion: 2.20 time: 0.934369 Sep 01 14:06:31.365308 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 31/66] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:06:30 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1408 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:06:31.379040 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-ce501a55-1e59-4c6f-97c6-cf28d1d2e06d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:31.380015 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-ce501a55-1e59-4c6f-97c6-cf28d1d2e06d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:31.395850 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ce501a55-1e59-4c6f-97c6-cf28d1d2e06d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:31.396571 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ce501a55-1e59-4c6f-97c6-cf28d1d2e06d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:31.397080 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 36/67] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:30 2022] GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7 => generated 1315 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:31.397312 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ce501a55-1e59-4c6f-97c6-cf28d1d2e06d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:31.402438 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ce501a55-1e59-4c6f-97c6-cf28d1d2e06d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:31.402438 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ce501a55-1e59-4c6f-97c6-cf28d1d2e06d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:31.402438 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ce501a55-1e59-4c6f-97c6-cf28d1d2e06d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:31.414181 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-3b977a25-587b-44a7-a4b5-602d8bd2df37 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:31.417358 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-3b977a25-587b-44a7-a4b5-602d8bd2df37 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:31.446627 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3b977a25-587b-44a7-a4b5-602d8bd2df37 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:31.447852 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3b977a25-587b-44a7-a4b5-602d8bd2df37 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:31.448659 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3b977a25-587b-44a7-a4b5-602d8bd2df37 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:31.459506 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3b977a25-587b-44a7-a4b5-602d8bd2df37 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:31.459506 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3b977a25-587b-44a7-a4b5-602d8bd2df37 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:31.459506 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3b977a25-587b-44a7-a4b5-602d8bd2df37 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:31.582498 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-ce501a55-1e59-4c6f-97c6-cf28d1d2e06d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:31.598421 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-ce501a55-1e59-4c6f-97c6-cf28d1d2e06d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1279 microversion: 2.1 time: 0.230960 Sep 01 14:06:31.615116 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 32/68] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:31 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1279 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:31.666037 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-3b977a25-587b-44a7-a4b5-602d8bd2df37 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:31.683916 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-3b977a25-587b-44a7-a4b5-602d8bd2df37 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1297 microversion: 2.1 time: 0.284397 Sep 01 14:06:31.686296 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 37/69] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:31 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1297 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:32.409764 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-01a9bf0e-9515-4f39-9fe0-ec493625c383 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:32.411776 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-01a9bf0e-9515-4f39-9fe0-ec493625c383 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] [instance: 3000b992-fcbf-472e-a1e0-11b101af43a7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:32.413303 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-f54c8de3-6803-4c80-824c-62bff884a752 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:32.414449 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-f54c8de3-6803-4c80-824c-62bff884a752 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:32.429342 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-01a9bf0e-9515-4f39-9fe0-ec493625c383 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:32.442422 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-01a9bf0e-9515-4f39-9fe0-ec493625c383 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:32.442591 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f54c8de3-6803-4c80-824c-62bff884a752 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:32.442591 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f54c8de3-6803-4c80-824c-62bff884a752 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:32.442591 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f54c8de3-6803-4c80-824c-62bff884a752 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:32.442591 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f54c8de3-6803-4c80-824c-62bff884a752 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:32.443138 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f54c8de3-6803-4c80-824c-62bff884a752 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:32.443138 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f54c8de3-6803-4c80-824c-62bff884a752 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:32.446036 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-01a9bf0e-9515-4f39-9fe0-ec493625c383 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:32.448781 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-01a9bf0e-9515-4f39-9fe0-ec493625c383 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:32.459110 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-01a9bf0e-9515-4f39-9fe0-ec493625c383 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:32.460194 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-01a9bf0e-9515-4f39-9fe0-ec493625c383 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:33.351091 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell0:SELECT=6 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:33.752092 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-01a9bf0e-9515-4f39-9fe0-ec493625c383 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b991f5024e4b5dbe8510b7381b1dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f871b0e1d3154b6d8c297b12ae738be0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:33.795079 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-01a9bf0e-9515-4f39-9fe0-ec493625c383 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] 10.222.0.25 "GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7" status: 200 len: 1315 microversion: 2.1 time: 1.391631 Sep 01 14:06:33.795424 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 33/70] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:32 2022] GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7 => generated 1315 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:33.820175 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-5394f5cd-4ba2-4885-8077-be08d590c7d6 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:33.820175 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-5394f5cd-4ba2-4885-8077-be08d590c7d6 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:33.830087 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5394f5cd-4ba2-4885-8077-be08d590c7d6 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:33.831272 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5394f5cd-4ba2-4885-8077-be08d590c7d6 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:33.832107 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5394f5cd-4ba2-4885-8077-be08d590c7d6 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:33.833245 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5394f5cd-4ba2-4885-8077-be08d590c7d6 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:33.834216 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5394f5cd-4ba2-4885-8077-be08d590c7d6 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:33.834934 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5394f5cd-4ba2-4885-8077-be08d590c7d6 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:33.861742 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-f54c8de3-6803-4c80-824c-62bff884a752 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:33.879185 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-f54c8de3-6803-4c80-824c-62bff884a752 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:33.882507 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-f54c8de3-6803-4c80-824c-62bff884a752 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:33.884346 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-f54c8de3-6803-4c80-824c-62bff884a752 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1408 microversion: 2.20 time: 1.478259 Sep 01 14:06:33.925230 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 38/71] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:06:32 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1408 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:06:33.939487 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-e45d75fd-2f50-4c24-8e06-e3c7dff917c0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:33.940500 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-e45d75fd-2f50-4c24-8e06-e3c7dff917c0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:33.957656 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e45d75fd-2f50-4c24-8e06-e3c7dff917c0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:33.960100 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e45d75fd-2f50-4c24-8e06-e3c7dff917c0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:33.962384 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e45d75fd-2f50-4c24-8e06-e3c7dff917c0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:33.963276 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e45d75fd-2f50-4c24-8e06-e3c7dff917c0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:33.966683 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e45d75fd-2f50-4c24-8e06-e3c7dff917c0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:33.967449 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e45d75fd-2f50-4c24-8e06-e3c7dff917c0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:34.176698 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-e45d75fd-2f50-4c24-8e06-e3c7dff917c0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:34.180443 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell1:SELECT=100 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:34.191943 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-e45d75fd-2f50-4c24-8e06-e3c7dff917c0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1295 microversion: 2.1 time: 0.263278 Sep 01 14:06:34.195924 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 39/72] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:33 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1295 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:34.251320 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-5394f5cd-4ba2-4885-8077-be08d590c7d6 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:34.269279 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-5394f5cd-4ba2-4885-8077-be08d590c7d6 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1321 microversion: 2.1 time: 0.459496 Sep 01 14:06:34.271017 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 34/73] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:33 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1321 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:34.823825 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-c156e622-3971-4b5b-8358-cd31f8916e5e tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:34.823825 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-c156e622-3971-4b5b-8358-cd31f8916e5e tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] [instance: 3000b992-fcbf-472e-a1e0-11b101af43a7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:34.825698 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell0:SELECT=16 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:34.840922 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c156e622-3971-4b5b-8358-cd31f8916e5e tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:34.843259 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c156e622-3971-4b5b-8358-cd31f8916e5e tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:34.843806 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c156e622-3971-4b5b-8358-cd31f8916e5e tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:34.844595 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c156e622-3971-4b5b-8358-cd31f8916e5e tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:34.845051 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c156e622-3971-4b5b-8358-cd31f8916e5e tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:34.850638 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c156e622-3971-4b5b-8358-cd31f8916e5e tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:34.913864 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-e9f9cd58-79d1-41f3-bd5e-6470291c06ea tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:34.915545 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-e9f9cd58-79d1-41f3-bd5e-6470291c06ea tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:34.927659 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e9f9cd58-79d1-41f3-bd5e-6470291c06ea tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:34.928585 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e9f9cd58-79d1-41f3-bd5e-6470291c06ea tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:34.929485 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e9f9cd58-79d1-41f3-bd5e-6470291c06ea tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:34.930843 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e9f9cd58-79d1-41f3-bd5e-6470291c06ea tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:34.931626 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e9f9cd58-79d1-41f3-bd5e-6470291c06ea tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:34.932455 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e9f9cd58-79d1-41f3-bd5e-6470291c06ea tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:35.433248 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-e9f9cd58-79d1-41f3-bd5e-6470291c06ea tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:35.448544 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-e9f9cd58-79d1-41f3-bd5e-6470291c06ea tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:35.452318 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-e9f9cd58-79d1-41f3-bd5e-6470291c06ea tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:35.454285 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-e9f9cd58-79d1-41f3-bd5e-6470291c06ea tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1408 microversion: 2.20 time: 0.544953 Sep 01 14:06:35.456193 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 35/74] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:06:34 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1408 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:06:35.461979 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-331bf658-b6ad-4ce8-a9d7-2f8903eebb94 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:35.462951 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-331bf658-b6ad-4ce8-a9d7-2f8903eebb94 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:35.472235 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-331bf658-b6ad-4ce8-a9d7-2f8903eebb94 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:35.473574 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-331bf658-b6ad-4ce8-a9d7-2f8903eebb94 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:35.474278 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-331bf658-b6ad-4ce8-a9d7-2f8903eebb94 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:35.475476 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-331bf658-b6ad-4ce8-a9d7-2f8903eebb94 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:35.476113 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-331bf658-b6ad-4ce8-a9d7-2f8903eebb94 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:35.476803 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-331bf658-b6ad-4ce8-a9d7-2f8903eebb94 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:35.477424 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell0:SELECT=20 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:35.494991 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-c156e622-3971-4b5b-8358-cd31f8916e5e tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b991f5024e4b5dbe8510b7381b1dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f871b0e1d3154b6d8c297b12ae738be0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:35.506587 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-c156e622-3971-4b5b-8358-cd31f8916e5e tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] 10.222.0.25 "GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7" status: 200 len: 1315 microversion: 2.1 time: 0.689431 Sep 01 14:06:35.507880 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 40/75] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:34 2022] GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7 => generated 1315 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:35.528183 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-352c3c7c-78ff-4596-af21-3d56920dcb04 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:35.533520 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-352c3c7c-78ff-4596-af21-3d56920dcb04 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:35.549314 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-352c3c7c-78ff-4596-af21-3d56920dcb04 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:35.553043 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-352c3c7c-78ff-4596-af21-3d56920dcb04 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:35.554207 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-352c3c7c-78ff-4596-af21-3d56920dcb04 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:35.555422 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-352c3c7c-78ff-4596-af21-3d56920dcb04 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:35.556631 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-352c3c7c-78ff-4596-af21-3d56920dcb04 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:35.557815 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-352c3c7c-78ff-4596-af21-3d56920dcb04 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:35.991111 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-331bf658-b6ad-4ce8-a9d7-2f8903eebb94 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:36.014167 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-352c3c7c-78ff-4596-af21-3d56920dcb04 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:36.036235 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-331bf658-b6ad-4ce8-a9d7-2f8903eebb94 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1363 microversion: 2.1 time: 0.578207 Sep 01 14:06:36.037705 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 36/76] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:35 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1363 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:36.041605 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-352c3c7c-78ff-4596-af21-3d56920dcb04 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1321 microversion: 2.1 time: 0.532007 Sep 01 14:06:36.043083 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 41/77] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:35 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1321 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:36.463027 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [req-4d3b8ce6-8660-405d-9cbe-ae8474e1062d req-93a87a71-2887-4416-afb1-d4f36b624b19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3000b992-fcbf-472e-a1e0-11b101af43a7", "name": "network-vif-plugged", "status": "completed", "tag": "c244d57b-8a64-435a-8910-dd80fa1b3bd5"}]} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:06:36.488876 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-99aac7ee-ece3-4d3a-b5a8-c05f1ff747e7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:36.489825 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-99aac7ee-ece3-4d3a-b5a8-c05f1ff747e7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:36.521547 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-4d3b8ce6-8660-405d-9cbe-ae8474e1062d req-93a87a71-2887-4416-afb1-d4f36b624b19 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:36.531331 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-4d3b8ce6-8660-405d-9cbe-ae8474e1062d req-93a87a71-2887-4416-afb1-d4f36b624b19 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:36.534888 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-4d3b8ce6-8660-405d-9cbe-ae8474e1062d req-93a87a71-2887-4416-afb1-d4f36b624b19 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:36.541735 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-99aac7ee-ece3-4d3a-b5a8-c05f1ff747e7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:36.543101 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-99aac7ee-ece3-4d3a-b5a8-c05f1ff747e7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:36.546924 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-99aac7ee-ece3-4d3a-b5a8-c05f1ff747e7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:36.551166 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-99aac7ee-ece3-4d3a-b5a8-c05f1ff747e7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:36.552068 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-99aac7ee-ece3-4d3a-b5a8-c05f1ff747e7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:36.558140 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-99aac7ee-ece3-4d3a-b5a8-c05f1ff747e7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:36.639282 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.compute.server_external_events [req-4d3b8ce6-8660-405d-9cbe-ae8474e1062d req-93a87a71-2887-4416-afb1-d4f36b624b19 service nova] Creating event network-vif-plugged:c244d57b-8a64-435a-8910-dd80fa1b3bd5 for instance 3000b992-fcbf-472e-a1e0-11b101af43a7 on hv-cinder-85221 Sep 01 14:06:36.671302 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [req-4d3b8ce6-8660-405d-9cbe-ae8474e1062d req-93a87a71-2887-4416-afb1-d4f36b624b19 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.377285 Sep 01 14:06:36.674265 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 37/78] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:06:36.699920 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-6dd87c22-71ac-4bc6-8a32-ebc304fa1a6e tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:36.701260 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-6dd87c22-71ac-4bc6-8a32-ebc304fa1a6e tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] [instance: 3000b992-fcbf-472e-a1e0-11b101af43a7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:36.723513 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6dd87c22-71ac-4bc6-8a32-ebc304fa1a6e tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:36.725767 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6dd87c22-71ac-4bc6-8a32-ebc304fa1a6e tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:36.727691 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6dd87c22-71ac-4bc6-8a32-ebc304fa1a6e tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:36.728627 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6dd87c22-71ac-4bc6-8a32-ebc304fa1a6e tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:36.730511 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6dd87c22-71ac-4bc6-8a32-ebc304fa1a6e tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:36.732617 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6dd87c22-71ac-4bc6-8a32-ebc304fa1a6e tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:37.069619 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-99aac7ee-ece3-4d3a-b5a8-c05f1ff747e7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:37.077844 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-6dd87c22-71ac-4bc6-8a32-ebc304fa1a6e tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b991f5024e4b5dbe8510b7381b1dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f871b0e1d3154b6d8c297b12ae738be0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:37.103511 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-99aac7ee-ece3-4d3a-b5a8-c05f1ff747e7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:37.108941 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-6dd87c22-71ac-4bc6-8a32-ebc304fa1a6e tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] 10.222.0.25 "GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7" status: 200 len: 1315 microversion: 2.1 time: 0.429426 Sep 01 14:06:37.109995 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 38/79] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:36 2022] GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7 => generated 1315 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:37.138578 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-99aac7ee-ece3-4d3a-b5a8-c05f1ff747e7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:37.140103 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-99aac7ee-ece3-4d3a-b5a8-c05f1ff747e7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1408 microversion: 2.20 time: 0.660443 Sep 01 14:06:37.141095 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 42/80] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:06:36 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1408 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:06:37.146898 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [req-15fa6f26-a65d-44f3-8743-6b496fb8071d req-642c335d-8d9a-4fa3-b7af-164f2e9069d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c1dec77-467a-4bb0-802c-6d7373f0aca5", "tag": "67860822-2188-4a43-8002-58ea70df2c86"}]} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:06:37.148402 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-d1585a64-8a1c-4176-a697-16f41d90bef4 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:37.149094 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-d1585a64-8a1c-4176-a697-16f41d90bef4 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:37.160367 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d1585a64-8a1c-4176-a697-16f41d90bef4 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:37.163825 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d1585a64-8a1c-4176-a697-16f41d90bef4 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:37.165460 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-15fa6f26-a65d-44f3-8743-6b496fb8071d req-642c335d-8d9a-4fa3-b7af-164f2e9069d5 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:37.166611 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d1585a64-8a1c-4176-a697-16f41d90bef4 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:37.167679 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-15fa6f26-a65d-44f3-8743-6b496fb8071d req-642c335d-8d9a-4fa3-b7af-164f2e9069d5 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:37.170291 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d1585a64-8a1c-4176-a697-16f41d90bef4 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:37.171296 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-15fa6f26-a65d-44f3-8743-6b496fb8071d req-642c335d-8d9a-4fa3-b7af-164f2e9069d5 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:37.172267 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d1585a64-8a1c-4176-a697-16f41d90bef4 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:37.174497 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d1585a64-8a1c-4176-a697-16f41d90bef4 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:37.214281 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.compute.server_external_events [req-15fa6f26-a65d-44f3-8743-6b496fb8071d req-642c335d-8d9a-4fa3-b7af-164f2e9069d5 service nova] Creating event network-changed:67860822-2188-4a43-8002-58ea70df2c86 for instance 4c1dec77-467a-4bb0-802c-6d7373f0aca5 on hv-cinder-85221 Sep 01 14:06:37.235112 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [req-15fa6f26-a65d-44f3-8743-6b496fb8071d req-642c335d-8d9a-4fa3-b7af-164f2e9069d5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096000 Sep 01 14:06:37.242247 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 39/81] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:06:37.257153 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-3a1f4e8e-7fd1-4222-a007-f089b7d592b5 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:37.260424 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-3a1f4e8e-7fd1-4222-a007-f089b7d592b5 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:37.274981 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3a1f4e8e-7fd1-4222-a007-f089b7d592b5 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:37.277226 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3a1f4e8e-7fd1-4222-a007-f089b7d592b5 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:37.278601 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3a1f4e8e-7fd1-4222-a007-f089b7d592b5 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:37.280204 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3a1f4e8e-7fd1-4222-a007-f089b7d592b5 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:37.281738 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3a1f4e8e-7fd1-4222-a007-f089b7d592b5 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:37.285729 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3a1f4e8e-7fd1-4222-a007-f089b7d592b5 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:37.610220 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-d1585a64-8a1c-4176-a697-16f41d90bef4 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:37.636149 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-d1585a64-8a1c-4176-a697-16f41d90bef4 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1363 microversion: 2.1 time: 0.493200 Sep 01 14:06:37.639190 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 43/82] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:37 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1363 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:37.753789 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-3a1f4e8e-7fd1-4222-a007-f089b7d592b5 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:37.782597 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-3a1f4e8e-7fd1-4222-a007-f089b7d592b5 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1321 microversion: 2.1 time: 0.530590 Sep 01 14:06:37.802035 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 40/83] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:37 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1321 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:38.146100 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-b2b1f302-b8ac-49ce-96ea-4a6156422fa4 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:38.147048 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-b2b1f302-b8ac-49ce-96ea-4a6156422fa4 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] [instance: 3000b992-fcbf-472e-a1e0-11b101af43a7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:38.154242 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b2b1f302-b8ac-49ce-96ea-4a6156422fa4 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:38.154730 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b2b1f302-b8ac-49ce-96ea-4a6156422fa4 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:38.155358 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b2b1f302-b8ac-49ce-96ea-4a6156422fa4 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:38.156131 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b2b1f302-b8ac-49ce-96ea-4a6156422fa4 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:38.156665 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b2b1f302-b8ac-49ce-96ea-4a6156422fa4 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:38.160163 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b2b1f302-b8ac-49ce-96ea-4a6156422fa4 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:38.171040 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-b94b777e-801c-4e07-9114-d213eb955bce tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:38.175817 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-b94b777e-801c-4e07-9114-d213eb955bce tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:38.195650 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b94b777e-801c-4e07-9114-d213eb955bce tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:38.224878 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b94b777e-801c-4e07-9114-d213eb955bce tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:38.225695 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b94b777e-801c-4e07-9114-d213eb955bce tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:38.227030 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b94b777e-801c-4e07-9114-d213eb955bce tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:38.230175 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b94b777e-801c-4e07-9114-d213eb955bce tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:38.231619 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b94b777e-801c-4e07-9114-d213eb955bce tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:38.404535 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell0:SELECT=6 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:38.520796 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-b94b777e-801c-4e07-9114-d213eb955bce tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:38.539533 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-b94b777e-801c-4e07-9114-d213eb955bce tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:38.544386 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-b94b777e-801c-4e07-9114-d213eb955bce tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:38.549281 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-b94b777e-801c-4e07-9114-d213eb955bce tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1408 microversion: 2.20 time: 0.386470 Sep 01 14:06:38.549731 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-b2b1f302-b8ac-49ce-96ea-4a6156422fa4 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b991f5024e4b5dbe8510b7381b1dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f871b0e1d3154b6d8c297b12ae738be0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:38.551011 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 41/84] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:06:38 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1408 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:06:38.559510 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-b2b1f302-b8ac-49ce-96ea-4a6156422fa4 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] 10.222.0.25 "GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7" status: 200 len: 1315 microversion: 2.1 time: 0.417860 Sep 01 14:06:38.560742 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 44/85] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:38 2022] GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7 => generated 1315 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:06:38.660879 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-5c36e27e-f85a-4d5f-9a4b-6135ac18bffb tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:38.661983 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-5c36e27e-f85a-4d5f-9a4b-6135ac18bffb tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:38.669457 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5c36e27e-f85a-4d5f-9a4b-6135ac18bffb tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:38.670053 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5c36e27e-f85a-4d5f-9a4b-6135ac18bffb tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:38.670489 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5c36e27e-f85a-4d5f-9a4b-6135ac18bffb tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:38.671276 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5c36e27e-f85a-4d5f-9a4b-6135ac18bffb tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:38.671733 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5c36e27e-f85a-4d5f-9a4b-6135ac18bffb tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:38.672151 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5c36e27e-f85a-4d5f-9a4b-6135ac18bffb tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:38.715725 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [req-03019a90-40b3-4312-9d8e-1677678a5419 req-e83cf2e4-7e92-4730-9b76-c394483bef97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "846e670d-c808-44d5-be0e-9c36671fbe91", "name": "network-vif-plugged", "status": "completed", "tag": "073b1d8b-8a54-4df8-a7c0-5ad23c885880"}]} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:06:38.727694 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-03019a90-40b3-4312-9d8e-1677678a5419 req-e83cf2e4-7e92-4730-9b76-c394483bef97 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:38.728186 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-03019a90-40b3-4312-9d8e-1677678a5419 req-e83cf2e4-7e92-4730-9b76-c394483bef97 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:38.728600 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-03019a90-40b3-4312-9d8e-1677678a5419 req-e83cf2e4-7e92-4730-9b76-c394483bef97 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:38.743263 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.compute.server_external_events [req-03019a90-40b3-4312-9d8e-1677678a5419 req-e83cf2e4-7e92-4730-9b76-c394483bef97 service nova] Creating event network-vif-plugged:073b1d8b-8a54-4df8-a7c0-5ad23c885880 for instance 846e670d-c808-44d5-be0e-9c36671fbe91 on hv-cinder-85221 Sep 01 14:06:38.750062 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [req-03019a90-40b3-4312-9d8e-1677678a5419 req-e83cf2e4-7e92-4730-9b76-c394483bef97 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038137 Sep 01 14:06:38.750658 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 45/86] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:06:38.815532 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-400af9ad-95db-4bb7-9480-641a18501d69 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:38.817292 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-400af9ad-95db-4bb7-9480-641a18501d69 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:38.835377 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-400af9ad-95db-4bb7-9480-641a18501d69 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:38.837607 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-400af9ad-95db-4bb7-9480-641a18501d69 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:38.837607 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-400af9ad-95db-4bb7-9480-641a18501d69 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:38.839713 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-400af9ad-95db-4bb7-9480-641a18501d69 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:38.841262 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-400af9ad-95db-4bb7-9480-641a18501d69 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:38.842377 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-400af9ad-95db-4bb7-9480-641a18501d69 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:38.867828 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-5c36e27e-f85a-4d5f-9a4b-6135ac18bffb tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:38.888948 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-5c36e27e-f85a-4d5f-9a4b-6135ac18bffb tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1363 microversion: 2.1 time: 0.232100 Sep 01 14:06:38.906499 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 42/87] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:38 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1363 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:39.128004 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-400af9ad-95db-4bb7-9480-641a18501d69 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:39.137081 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-400af9ad-95db-4bb7-9480-641a18501d69 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1321 microversion: 2.1 time: 0.326487 Sep 01 14:06:39.137763 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 46/88] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:38 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1321 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:39.270665 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [req-12d49dda-ed8d-4ec9-94fd-57b6e0f89343 req-b40238f6-6822-46e6-bd36-58605aff9ba6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c2b8351-0db7-45ab-848a-1e339e67bcf7", "tag": "39a55af7-1a2a-41f8-b092-76d3ddca0161"}]} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:06:39.283207 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-12d49dda-ed8d-4ec9-94fd-57b6e0f89343 req-b40238f6-6822-46e6-bd36-58605aff9ba6 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:39.284027 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-12d49dda-ed8d-4ec9-94fd-57b6e0f89343 req-b40238f6-6822-46e6-bd36-58605aff9ba6 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:39.284507 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-12d49dda-ed8d-4ec9-94fd-57b6e0f89343 req-b40238f6-6822-46e6-bd36-58605aff9ba6 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:39.300629 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.compute.server_external_events [req-12d49dda-ed8d-4ec9-94fd-57b6e0f89343 req-b40238f6-6822-46e6-bd36-58605aff9ba6 service nova] Creating event network-changed:39a55af7-1a2a-41f8-b092-76d3ddca0161 for instance 1c2b8351-0db7-45ab-848a-1e339e67bcf7 on hv-cinder-85221 Sep 01 14:06:39.307521 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [req-12d49dda-ed8d-4ec9-94fd-57b6e0f89343 req-b40238f6-6822-46e6-bd36-58605aff9ba6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041937 Sep 01 14:06:39.308663 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 43/89] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:06:39.575732 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-445dcbbf-9d38-4c2e-8531-3a6f0a131c54 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:39.576347 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-445dcbbf-9d38-4c2e-8531-3a6f0a131c54 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:39.592635 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-445dcbbf-9d38-4c2e-8531-3a6f0a131c54 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:39.594732 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-445dcbbf-9d38-4c2e-8531-3a6f0a131c54 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:39.598566 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-445dcbbf-9d38-4c2e-8531-3a6f0a131c54 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:39.604603 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-445dcbbf-9d38-4c2e-8531-3a6f0a131c54 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:39.605345 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-445dcbbf-9d38-4c2e-8531-3a6f0a131c54 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:39.606022 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-445dcbbf-9d38-4c2e-8531-3a6f0a131c54 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:39.617767 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-8ee5ab02-c61b-4976-a889-0328c3a34c13 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:39.619335 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-8ee5ab02-c61b-4976-a889-0328c3a34c13 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] [instance: 3000b992-fcbf-472e-a1e0-11b101af43a7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:39.636122 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8ee5ab02-c61b-4976-a889-0328c3a34c13 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:39.638688 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8ee5ab02-c61b-4976-a889-0328c3a34c13 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:39.639825 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8ee5ab02-c61b-4976-a889-0328c3a34c13 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:39.641561 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8ee5ab02-c61b-4976-a889-0328c3a34c13 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:39.644279 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8ee5ab02-c61b-4976-a889-0328c3a34c13 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:39.645835 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8ee5ab02-c61b-4976-a889-0328c3a34c13 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:40.076780 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-445dcbbf-9d38-4c2e-8531-3a6f0a131c54 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:40.091698 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-445dcbbf-9d38-4c2e-8531-3a6f0a131c54 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:40.093954 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-8ee5ab02-c61b-4976-a889-0328c3a34c13 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b991f5024e4b5dbe8510b7381b1dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f871b0e1d3154b6d8c297b12ae738be0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:40.094416 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-445dcbbf-9d38-4c2e-8531-3a6f0a131c54 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:40.097204 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-445dcbbf-9d38-4c2e-8531-3a6f0a131c54 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1408 microversion: 2.20 time: 0.525436 Sep 01 14:06:40.116657 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 47/90] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:06:39 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1408 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:06:40.123054 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-b5fd0d6a-c2a3-4c9d-9399-c7f5048ff4bf tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:40.123908 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-b5fd0d6a-c2a3-4c9d-9399-c7f5048ff4bf tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:40.124346 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-8ee5ab02-c61b-4976-a889-0328c3a34c13 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] 10.222.0.25 "GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7" status: 200 len: 1315 microversion: 2.1 time: 0.528444 Sep 01 14:06:40.132885 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 44/91] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:39 2022] GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7 => generated 1315 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:40.137203 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b5fd0d6a-c2a3-4c9d-9399-c7f5048ff4bf tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:40.138014 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b5fd0d6a-c2a3-4c9d-9399-c7f5048ff4bf tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:40.138955 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b5fd0d6a-c2a3-4c9d-9399-c7f5048ff4bf tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:40.149213 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b5fd0d6a-c2a3-4c9d-9399-c7f5048ff4bf tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:40.160096 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-6c711a0c-a1fc-46e7-afc8-8d055a6138ac tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:40.160886 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-6c711a0c-a1fc-46e7-afc8-8d055a6138ac tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:40.164018 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b5fd0d6a-c2a3-4c9d-9399-c7f5048ff4bf tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:40.164587 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b5fd0d6a-c2a3-4c9d-9399-c7f5048ff4bf tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:40.180523 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6c711a0c-a1fc-46e7-afc8-8d055a6138ac tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:40.181108 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6c711a0c-a1fc-46e7-afc8-8d055a6138ac tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:40.181577 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6c711a0c-a1fc-46e7-afc8-8d055a6138ac tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:40.184553 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6c711a0c-a1fc-46e7-afc8-8d055a6138ac tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:40.196059 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6c711a0c-a1fc-46e7-afc8-8d055a6138ac tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:40.196059 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6c711a0c-a1fc-46e7-afc8-8d055a6138ac tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:40.458569 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-b5fd0d6a-c2a3-4c9d-9399-c7f5048ff4bf tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:40.470824 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-b5fd0d6a-c2a3-4c9d-9399-c7f5048ff4bf tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1363 microversion: 2.1 time: 0.351983 Sep 01 14:06:40.471423 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 48/92] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:40 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1363 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:40.499342 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-6c711a0c-a1fc-46e7-afc8-8d055a6138ac tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:40.509183 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-6c711a0c-a1fc-46e7-afc8-8d055a6138ac tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1321 microversion: 2.1 time: 0.354213 Sep 01 14:06:40.510057 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 45/93] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:40 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1321 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:40.772127 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [req-97b75875-6fad-4580-865b-2f7fce76278c req-25b9bff7-dcb2-4636-9bb0-a5d4297342ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d39f7090-b419-46be-9fcc-7ae73004ab71", "name": "network-vif-plugged", "status": "completed", "tag": "9ae4ab09-714c-4175-ba0d-7b76b31e652d"}]} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:06:40.786299 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-97b75875-6fad-4580-865b-2f7fce76278c req-25b9bff7-dcb2-4636-9bb0-a5d4297342ce service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:40.787016 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-97b75875-6fad-4580-865b-2f7fce76278c req-25b9bff7-dcb2-4636-9bb0-a5d4297342ce service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:40.787596 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-97b75875-6fad-4580-865b-2f7fce76278c req-25b9bff7-dcb2-4636-9bb0-a5d4297342ce service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:40.804782 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.compute.server_external_events [req-97b75875-6fad-4580-865b-2f7fce76278c req-25b9bff7-dcb2-4636-9bb0-a5d4297342ce service nova] Creating event network-vif-plugged:9ae4ab09-714c-4175-ba0d-7b76b31e652d for instance d39f7090-b419-46be-9fcc-7ae73004ab71 on hv-cinder-85221 Sep 01 14:06:40.812875 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [req-97b75875-6fad-4580-865b-2f7fce76278c req-25b9bff7-dcb2-4636-9bb0-a5d4297342ce service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048000 Sep 01 14:06:40.815596 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 49/94] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:06:41.122267 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-c32da1ad-095d-4f71-98c1-a00e78e7e7d7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:41.123032 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-c32da1ad-095d-4f71-98c1-a00e78e7e7d7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:41.136070 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c32da1ad-095d-4f71-98c1-a00e78e7e7d7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:41.145226 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c32da1ad-095d-4f71-98c1-a00e78e7e7d7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:41.145226 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c32da1ad-095d-4f71-98c1-a00e78e7e7d7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:41.145226 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c32da1ad-095d-4f71-98c1-a00e78e7e7d7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:41.145226 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c32da1ad-095d-4f71-98c1-a00e78e7e7d7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:41.145568 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c32da1ad-095d-4f71-98c1-a00e78e7e7d7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:41.165681 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-1139d4c3-98e1-43da-b262-83ab852f38a4 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:41.178181 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-1139d4c3-98e1-43da-b262-83ab852f38a4 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] [instance: 3000b992-fcbf-472e-a1e0-11b101af43a7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:41.196219 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1139d4c3-98e1-43da-b262-83ab852f38a4 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:41.197085 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1139d4c3-98e1-43da-b262-83ab852f38a4 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:41.198357 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1139d4c3-98e1-43da-b262-83ab852f38a4 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:41.200582 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1139d4c3-98e1-43da-b262-83ab852f38a4 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:41.201556 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1139d4c3-98e1-43da-b262-83ab852f38a4 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:41.202997 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1139d4c3-98e1-43da-b262-83ab852f38a4 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:41.392818 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-c32da1ad-095d-4f71-98c1-a00e78e7e7d7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:41.403847 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-c32da1ad-095d-4f71-98c1-a00e78e7e7d7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:41.407089 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-c32da1ad-095d-4f71-98c1-a00e78e7e7d7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:41.409410 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-c32da1ad-095d-4f71-98c1-a00e78e7e7d7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1408 microversion: 2.20 time: 0.290789 Sep 01 14:06:41.410833 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 46/95] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:06:41 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1408 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:06:41.442970 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-1139d4c3-98e1-43da-b262-83ab852f38a4 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b991f5024e4b5dbe8510b7381b1dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f871b0e1d3154b6d8c297b12ae738be0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:41.452534 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-1139d4c3-98e1-43da-b262-83ab852f38a4 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] 10.222.0.25 "GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7" status: 200 len: 1503 microversion: 2.1 time: 0.296729 Sep 01 14:06:41.454214 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 50/96] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:41 2022] GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7 => generated 1503 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:41.521168 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-c4d8c8f6-19f4-44c1-8d00-2f166faa88e0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:41.522700 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-c4d8c8f6-19f4-44c1-8d00-2f166faa88e0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:41.541849 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-73babf3a-ebf3-47b9-8283-83810cee6a6d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:41.542739 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-73babf3a-ebf3-47b9-8283-83810cee6a6d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:41.545040 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c4d8c8f6-19f4-44c1-8d00-2f166faa88e0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:41.547470 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c4d8c8f6-19f4-44c1-8d00-2f166faa88e0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:41.548321 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c4d8c8f6-19f4-44c1-8d00-2f166faa88e0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:41.550618 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c4d8c8f6-19f4-44c1-8d00-2f166faa88e0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:41.551529 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c4d8c8f6-19f4-44c1-8d00-2f166faa88e0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:41.552201 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c4d8c8f6-19f4-44c1-8d00-2f166faa88e0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:41.559039 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-73babf3a-ebf3-47b9-8283-83810cee6a6d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:41.559546 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-73babf3a-ebf3-47b9-8283-83810cee6a6d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:41.561011 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-73babf3a-ebf3-47b9-8283-83810cee6a6d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:41.564629 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-73babf3a-ebf3-47b9-8283-83810cee6a6d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:41.565172 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-73babf3a-ebf3-47b9-8283-83810cee6a6d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:41.570219 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-73babf3a-ebf3-47b9-8283-83810cee6a6d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:41.588850 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell1:SELECT=100 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:41.901593 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-73babf3a-ebf3-47b9-8283-83810cee6a6d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:41.914576 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-73babf3a-ebf3-47b9-8283-83810cee6a6d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1321 microversion: 2.1 time: 0.379361 Sep 01 14:06:41.915448 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 51/97] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:41 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1321 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:41.932961 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-c4d8c8f6-19f4-44c1-8d00-2f166faa88e0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:41.941566 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-c4d8c8f6-19f4-44c1-8d00-2f166faa88e0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1363 microversion: 2.1 time: 0.448146 Sep 01 14:06:41.942396 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 47/98] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:41 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1363 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:42.433303 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-cf7e0936-5ddb-4a33-8d55-fde537e9a0e4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:42.434231 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-cf7e0936-5ddb-4a33-8d55-fde537e9a0e4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:42.442317 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-cf7e0936-5ddb-4a33-8d55-fde537e9a0e4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:42.442876 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-cf7e0936-5ddb-4a33-8d55-fde537e9a0e4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:42.443373 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-cf7e0936-5ddb-4a33-8d55-fde537e9a0e4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:42.444101 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-cf7e0936-5ddb-4a33-8d55-fde537e9a0e4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:42.444584 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-cf7e0936-5ddb-4a33-8d55-fde537e9a0e4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:42.445227 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-cf7e0936-5ddb-4a33-8d55-fde537e9a0e4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:42.684283 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-cf7e0936-5ddb-4a33-8d55-fde537e9a0e4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:42.703414 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-cf7e0936-5ddb-4a33-8d55-fde537e9a0e4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:42.705504 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-cf7e0936-5ddb-4a33-8d55-fde537e9a0e4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:42.707090 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-cf7e0936-5ddb-4a33-8d55-fde537e9a0e4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1408 microversion: 2.20 time: 0.277897 Sep 01 14:06:42.707566 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 52/99] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:06:42 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1408 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:06:42.941975 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-8cd54995-1054-473e-9a91-f0c09315fcab tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:42.942802 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-8cd54995-1054-473e-9a91-f0c09315fcab tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:42.949516 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8cd54995-1054-473e-9a91-f0c09315fcab tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:42.950045 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8cd54995-1054-473e-9a91-f0c09315fcab tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:42.950469 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8cd54995-1054-473e-9a91-f0c09315fcab tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:42.951172 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8cd54995-1054-473e-9a91-f0c09315fcab tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:42.951619 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8cd54995-1054-473e-9a91-f0c09315fcab tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:42.952034 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8cd54995-1054-473e-9a91-f0c09315fcab tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:42.963807 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-ac5153da-4f3f-4000-be5f-1253d9d8cca6 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:42.964422 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-ac5153da-4f3f-4000-be5f-1253d9d8cca6 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:42.975478 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ac5153da-4f3f-4000-be5f-1253d9d8cca6 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:42.976344 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ac5153da-4f3f-4000-be5f-1253d9d8cca6 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:42.983661 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ac5153da-4f3f-4000-be5f-1253d9d8cca6 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:42.983661 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ac5153da-4f3f-4000-be5f-1253d9d8cca6 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:42.983661 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ac5153da-4f3f-4000-be5f-1253d9d8cca6 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:42.983661 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ac5153da-4f3f-4000-be5f-1253d9d8cca6 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:43.454456 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-8cd54995-1054-473e-9a91-f0c09315fcab tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:43.454456 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-8cd54995-1054-473e-9a91-f0c09315fcab tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1321 microversion: 2.1 time: 0.435869 Sep 01 14:06:43.454456 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 48/100] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:42 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1321 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:06:43.455681 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-ac5153da-4f3f-4000-be5f-1253d9d8cca6 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:43.455681 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-ac5153da-4f3f-4000-be5f-1253d9d8cca6 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1363 microversion: 2.1 time: 0.452320 Sep 01 14:06:43.455681 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 53/101] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:42 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1363 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:06:43.731499 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-7319acb5-5b49-48f6-975f-fe8b1bcd4ef9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:43.732262 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-7319acb5-5b49-48f6-975f-fe8b1bcd4ef9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:43.740569 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7319acb5-5b49-48f6-975f-fe8b1bcd4ef9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:43.741063 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7319acb5-5b49-48f6-975f-fe8b1bcd4ef9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:43.741497 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7319acb5-5b49-48f6-975f-fe8b1bcd4ef9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:43.742478 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7319acb5-5b49-48f6-975f-fe8b1bcd4ef9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:43.742964 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7319acb5-5b49-48f6-975f-fe8b1bcd4ef9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:43.743413 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7319acb5-5b49-48f6-975f-fe8b1bcd4ef9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:43.932976 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-7319acb5-5b49-48f6-975f-fe8b1bcd4ef9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:43.955896 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-7319acb5-5b49-48f6-975f-fe8b1bcd4ef9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:43.993472 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-7319acb5-5b49-48f6-975f-fe8b1bcd4ef9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:43.993472 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-7319acb5-5b49-48f6-975f-fe8b1bcd4ef9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1408 microversion: 2.20 time: 0.233635 Sep 01 14:06:43.993472 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 49/102] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:06:43 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1408 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:06:44.479423 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-2cf88cfe-d467-44ce-88ee-a742b9c6a60d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:44.480313 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-2cf88cfe-d467-44ce-88ee-a742b9c6a60d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:44.480564 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-1d7e8ba8-1663-4969-b0b4-dcdbede4afb8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:44.481341 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-1d7e8ba8-1663-4969-b0b4-dcdbede4afb8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:44.489310 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1d7e8ba8-1663-4969-b0b4-dcdbede4afb8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:44.489666 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2cf88cfe-d467-44ce-88ee-a742b9c6a60d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:44.490109 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1d7e8ba8-1663-4969-b0b4-dcdbede4afb8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:44.490336 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2cf88cfe-d467-44ce-88ee-a742b9c6a60d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:44.490813 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1d7e8ba8-1663-4969-b0b4-dcdbede4afb8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:44.491017 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2cf88cfe-d467-44ce-88ee-a742b9c6a60d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:44.491655 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1d7e8ba8-1663-4969-b0b4-dcdbede4afb8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:44.491941 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2cf88cfe-d467-44ce-88ee-a742b9c6a60d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:44.492228 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1d7e8ba8-1663-4969-b0b4-dcdbede4afb8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:44.492617 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2cf88cfe-d467-44ce-88ee-a742b9c6a60d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:44.492786 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1d7e8ba8-1663-4969-b0b4-dcdbede4afb8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:44.493314 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2cf88cfe-d467-44ce-88ee-a742b9c6a60d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:44.743136 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-2cf88cfe-d467-44ce-88ee-a742b9c6a60d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:44.750765 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-1d7e8ba8-1663-4969-b0b4-dcdbede4afb8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:44.756759 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-2cf88cfe-d467-44ce-88ee-a742b9c6a60d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1363 microversion: 2.1 time: 0.281852 Sep 01 14:06:44.757970 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 54/103] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:44 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1363 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:06:44.761967 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-1d7e8ba8-1663-4969-b0b4-dcdbede4afb8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1321 microversion: 2.1 time: 0.285940 Sep 01 14:06:44.762841 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 50/104] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:44 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1321 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:06:45.013223 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-05e4fc05-b96d-4353-b0b4-d045660e61b6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:45.013629 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-05e4fc05-b96d-4353-b0b4-d045660e61b6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:45.026983 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-05e4fc05-b96d-4353-b0b4-d045660e61b6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:45.027880 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-05e4fc05-b96d-4353-b0b4-d045660e61b6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:45.028710 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-05e4fc05-b96d-4353-b0b4-d045660e61b6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:45.030047 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-05e4fc05-b96d-4353-b0b4-d045660e61b6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:45.030928 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-05e4fc05-b96d-4353-b0b4-d045660e61b6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:45.031701 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-05e4fc05-b96d-4353-b0b4-d045660e61b6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:45.194130 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-05e4fc05-b96d-4353-b0b4-d045660e61b6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:45.207649 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-05e4fc05-b96d-4353-b0b4-d045660e61b6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:45.211154 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-05e4fc05-b96d-4353-b0b4-d045660e61b6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:45.214509 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-05e4fc05-b96d-4353-b0b4-d045660e61b6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1408 microversion: 2.20 time: 0.205809 Sep 01 14:06:45.216809 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 55/105] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:06:45 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1408 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:06:45.779239 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-01ddacf7-b061-49d7-938b-24d3e761f6e2 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:45.780175 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-01ddacf7-b061-49d7-938b-24d3e761f6e2 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:45.787482 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-5af4de12-cfa2-47bb-b85c-b06e2662fc77 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:45.788567 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-5af4de12-cfa2-47bb-b85c-b06e2662fc77 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:45.788889 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-01ddacf7-b061-49d7-938b-24d3e761f6e2 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:45.789683 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-01ddacf7-b061-49d7-938b-24d3e761f6e2 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:45.790427 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-01ddacf7-b061-49d7-938b-24d3e761f6e2 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:45.791798 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-01ddacf7-b061-49d7-938b-24d3e761f6e2 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:45.792564 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-01ddacf7-b061-49d7-938b-24d3e761f6e2 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:45.793302 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-01ddacf7-b061-49d7-938b-24d3e761f6e2 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:45.799788 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5af4de12-cfa2-47bb-b85c-b06e2662fc77 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:45.800540 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5af4de12-cfa2-47bb-b85c-b06e2662fc77 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:45.801185 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5af4de12-cfa2-47bb-b85c-b06e2662fc77 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:45.802383 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5af4de12-cfa2-47bb-b85c-b06e2662fc77 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:45.803159 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5af4de12-cfa2-47bb-b85c-b06e2662fc77 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:45.803979 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5af4de12-cfa2-47bb-b85c-b06e2662fc77 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:46.052135 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-5af4de12-cfa2-47bb-b85c-b06e2662fc77 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:46.059433 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-01ddacf7-b061-49d7-938b-24d3e761f6e2 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:46.072002 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-5af4de12-cfa2-47bb-b85c-b06e2662fc77 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1321 microversion: 2.1 time: 0.290812 Sep 01 14:06:46.073121 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 56/106] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:45 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1321 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:06:46.079383 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-01ddacf7-b061-49d7-938b-24d3e761f6e2 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1363 microversion: 2.1 time: 0.303450 Sep 01 14:06:46.081263 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 51/107] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:45 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1363 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:06:46.259551 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-31196475-d787-4b36-b9db-eae5e6293b42 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:46.260184 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-31196475-d787-4b36-b9db-eae5e6293b42 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:46.266670 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-31196475-d787-4b36-b9db-eae5e6293b42 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:46.267661 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-31196475-d787-4b36-b9db-eae5e6293b42 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:46.268279 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-31196475-d787-4b36-b9db-eae5e6293b42 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:46.269200 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-31196475-d787-4b36-b9db-eae5e6293b42 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:46.269653 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-31196475-d787-4b36-b9db-eae5e6293b42 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:46.270136 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-31196475-d787-4b36-b9db-eae5e6293b42 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:46.546485 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-31196475-d787-4b36-b9db-eae5e6293b42 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:46.549835 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell1:SELECT=100 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:46.559385 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-31196475-d787-4b36-b9db-eae5e6293b42 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:46.566924 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-31196475-d787-4b36-b9db-eae5e6293b42 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:46.568563 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-31196475-d787-4b36-b9db-eae5e6293b42 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1408 microversion: 2.20 time: 0.313098 Sep 01 14:06:46.577921 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 57/108] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:06:46 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1408 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:06:47.014343 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [req-35ca704b-f5c3-4385-98d9-5f6466477571 req-51cfc2f9-c4dd-4592-9971-d850cd4c5e0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c1dec77-467a-4bb0-802c-6d7373f0aca5", "name": "network-vif-plugged", "status": "completed", "tag": "67860822-2188-4a43-8002-58ea70df2c86"}]} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:06:47.027357 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-35ca704b-f5c3-4385-98d9-5f6466477571 req-51cfc2f9-c4dd-4592-9971-d850cd4c5e0a service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:47.028229 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-35ca704b-f5c3-4385-98d9-5f6466477571 req-51cfc2f9-c4dd-4592-9971-d850cd4c5e0a service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:47.029006 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-35ca704b-f5c3-4385-98d9-5f6466477571 req-51cfc2f9-c4dd-4592-9971-d850cd4c5e0a service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:47.051997 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.compute.server_external_events [req-35ca704b-f5c3-4385-98d9-5f6466477571 req-51cfc2f9-c4dd-4592-9971-d850cd4c5e0a service nova] Creating event network-vif-plugged:67860822-2188-4a43-8002-58ea70df2c86 for instance 4c1dec77-467a-4bb0-802c-6d7373f0aca5 on hv-cinder-85221 Sep 01 14:06:47.061751 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [req-35ca704b-f5c3-4385-98d9-5f6466477571 req-51cfc2f9-c4dd-4592-9971-d850cd4c5e0a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052527 Sep 01 14:06:47.062887 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 52/109] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:06:47.065221 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-a304dc87-0a9b-4b33-8b24-4a1ff39154a7 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de4437ce-f170-47bd-a162-d303f1f1f678"}} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:06:47.069937 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-a304dc87-0a9b-4b33-8b24-4a1ff39154a7 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] [instance: 3000b992-fcbf-472e-a1e0-11b101af43a7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:47.076901 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a304dc87-0a9b-4b33-8b24-4a1ff39154a7 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:47.077416 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a304dc87-0a9b-4b33-8b24-4a1ff39154a7 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:47.077885 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a304dc87-0a9b-4b33-8b24-4a1ff39154a7 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:47.078645 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a304dc87-0a9b-4b33-8b24-4a1ff39154a7 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:47.079520 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a304dc87-0a9b-4b33-8b24-4a1ff39154a7 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:47.081838 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a304dc87-0a9b-4b33-8b24-4a1ff39154a7 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:47.111373 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-e5ac1f40-7243-4ed6-bd82-b0c87442f8be tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:47.117988 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-e5ac1f40-7243-4ed6-bd82-b0c87442f8be tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:47.144968 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e5ac1f40-7243-4ed6-bd82-b0c87442f8be tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:47.149439 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e5ac1f40-7243-4ed6-bd82-b0c87442f8be tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:47.150600 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e5ac1f40-7243-4ed6-bd82-b0c87442f8be tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:47.153540 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e5ac1f40-7243-4ed6-bd82-b0c87442f8be tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:47.156225 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e5ac1f40-7243-4ed6-bd82-b0c87442f8be tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:47.157153 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e5ac1f40-7243-4ed6-bd82-b0c87442f8be tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:47.949404 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-e5ac1f40-7243-4ed6-bd82-b0c87442f8be tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:47.960720 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-e5ac1f40-7243-4ed6-bd82-b0c87442f8be tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1363 microversion: 2.1 time: 0.861762 Sep 01 14:06:47.962105 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 53/110] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:47 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1363 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:06:47.971111 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-398c65b0-e322-4944-b368-889706770376 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:47.973028 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-398c65b0-e322-4944-b368-889706770376 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:47.983332 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-398c65b0-e322-4944-b368-889706770376 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:47.984278 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-398c65b0-e322-4944-b368-889706770376 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:47.989749 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-398c65b0-e322-4944-b368-889706770376 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:47.991542 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-398c65b0-e322-4944-b368-889706770376 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:47.992654 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-398c65b0-e322-4944-b368-889706770376 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:47.993249 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-398c65b0-e322-4944-b368-889706770376 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:48.213536 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-398c65b0-e322-4944-b368-889706770376 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:48.227922 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-398c65b0-e322-4944-b368-889706770376 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1321 microversion: 2.1 time: 0.263028 Sep 01 14:06:48.228914 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 54/111] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:47 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1321 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:48.238673 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-400b7bd6-9be2-4ffc-8acf-6dab5f5aa7c6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:48.240184 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-400b7bd6-9be2-4ffc-8acf-6dab5f5aa7c6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:48.251043 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-400b7bd6-9be2-4ffc-8acf-6dab5f5aa7c6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:48.252302 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-400b7bd6-9be2-4ffc-8acf-6dab5f5aa7c6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:48.253269 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-400b7bd6-9be2-4ffc-8acf-6dab5f5aa7c6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:48.254704 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-400b7bd6-9be2-4ffc-8acf-6dab5f5aa7c6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:48.255422 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-400b7bd6-9be2-4ffc-8acf-6dab5f5aa7c6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:48.256084 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-400b7bd6-9be2-4ffc-8acf-6dab5f5aa7c6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:48.538369 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-400b7bd6-9be2-4ffc-8acf-6dab5f5aa7c6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:48.556712 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-400b7bd6-9be2-4ffc-8acf-6dab5f5aa7c6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:48.560188 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-400b7bd6-9be2-4ffc-8acf-6dab5f5aa7c6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:48.561782 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-400b7bd6-9be2-4ffc-8acf-6dab5f5aa7c6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1408 microversion: 2.20 time: 0.330773 Sep 01 14:06:48.562824 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 55/112] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:06:48 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1408 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:06:49.006074 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-c3c9bd91-d8e6-44b5-afb5-394c3a978f4c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:49.007586 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-c3c9bd91-d8e6-44b5-afb5-394c3a978f4c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:49.015305 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c3c9bd91-d8e6-44b5-afb5-394c3a978f4c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:49.015874 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c3c9bd91-d8e6-44b5-afb5-394c3a978f4c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:49.016361 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c3c9bd91-d8e6-44b5-afb5-394c3a978f4c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:49.017130 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c3c9bd91-d8e6-44b5-afb5-394c3a978f4c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:49.018503 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c3c9bd91-d8e6-44b5-afb5-394c3a978f4c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:49.019252 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c3c9bd91-d8e6-44b5-afb5-394c3a978f4c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:49.091553 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-a304dc87-0a9b-4b33-8b24-4a1ff39154a7 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] 10.222.0.25 "POST /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.031034 Sep 01 14:06:49.102192 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 58/113] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Sep 1 14:06:47 2022] POST /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7/os-volume_attachments => generated 194 bytes in 2034 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:06:49.260948 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-9958ee58-7f66-46c9-ba16-b7a838842348 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:49.262891 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-9958ee58-7f66-46c9-ba16-b7a838842348 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:49.289017 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9958ee58-7f66-46c9-ba16-b7a838842348 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:49.290915 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9958ee58-7f66-46c9-ba16-b7a838842348 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:49.299150 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9958ee58-7f66-46c9-ba16-b7a838842348 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:49.300075 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9958ee58-7f66-46c9-ba16-b7a838842348 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:49.300757 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9958ee58-7f66-46c9-ba16-b7a838842348 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:49.303074 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9958ee58-7f66-46c9-ba16-b7a838842348 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:49.345612 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-c3c9bd91-d8e6-44b5-afb5-394c3a978f4c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:49.369000 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-c3c9bd91-d8e6-44b5-afb5-394c3a978f4c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1363 microversion: 2.1 time: 0.369225 Sep 01 14:06:49.378932 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 56/114] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:48 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1363 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:49.555700 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-9958ee58-7f66-46c9-ba16-b7a838842348 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:49.612303 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-9958ee58-7f66-46c9-ba16-b7a838842348 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1321 microversion: 2.1 time: 0.363681 Sep 01 14:06:49.616496 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 59/115] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:49 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1321 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:06:49.616884 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-c812a7c3-dda6-4a12-9c77-9c93b2db0fc5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:49.617062 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-c812a7c3-dda6-4a12-9c77-9c93b2db0fc5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:49.637573 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c812a7c3-dda6-4a12-9c77-9c93b2db0fc5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:49.638204 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c812a7c3-dda6-4a12-9c77-9c93b2db0fc5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:49.638907 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c812a7c3-dda6-4a12-9c77-9c93b2db0fc5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:49.639717 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c812a7c3-dda6-4a12-9c77-9c93b2db0fc5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:49.646187 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c812a7c3-dda6-4a12-9c77-9c93b2db0fc5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:49.647068 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c812a7c3-dda6-4a12-9c77-9c93b2db0fc5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:49.911166 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-c812a7c3-dda6-4a12-9c77-9c93b2db0fc5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:49.920298 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-c812a7c3-dda6-4a12-9c77-9c93b2db0fc5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:49.921992 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-c812a7c3-dda6-4a12-9c77-9c93b2db0fc5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:49.923271 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-c812a7c3-dda6-4a12-9c77-9c93b2db0fc5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1408 microversion: 2.20 time: 0.327955 Sep 01 14:06:49.923898 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 57/116] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:06:49 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1408 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:06:50.413482 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-fa83d4b8-e8d4-4476-9727-5fdb87ae169b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:50.415163 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-fa83d4b8-e8d4-4476-9727-5fdb87ae169b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:50.426487 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-fa83d4b8-e8d4-4476-9727-5fdb87ae169b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:50.427566 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-fa83d4b8-e8d4-4476-9727-5fdb87ae169b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:50.428577 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-fa83d4b8-e8d4-4476-9727-5fdb87ae169b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:50.430065 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-fa83d4b8-e8d4-4476-9727-5fdb87ae169b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:50.431316 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-fa83d4b8-e8d4-4476-9727-5fdb87ae169b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:50.432405 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-fa83d4b8-e8d4-4476-9727-5fdb87ae169b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:50.642965 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-1616e63c-62b6-4bf3-9e18-ad01610a3f1b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:50.645194 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-1616e63c-62b6-4bf3-9e18-ad01610a3f1b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:50.671036 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1616e63c-62b6-4bf3-9e18-ad01610a3f1b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:50.671932 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1616e63c-62b6-4bf3-9e18-ad01610a3f1b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:50.678255 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1616e63c-62b6-4bf3-9e18-ad01610a3f1b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:50.680002 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1616e63c-62b6-4bf3-9e18-ad01610a3f1b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:50.680868 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1616e63c-62b6-4bf3-9e18-ad01610a3f1b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:50.681664 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1616e63c-62b6-4bf3-9e18-ad01610a3f1b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:50.684515 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-fa83d4b8-e8d4-4476-9727-5fdb87ae169b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:50.693512 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-fa83d4b8-e8d4-4476-9727-5fdb87ae169b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1363 microversion: 2.1 time: 0.287752 Sep 01 14:06:50.694143 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 60/117] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:50 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1363 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:50.923861 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-1616e63c-62b6-4bf3-9e18-ad01610a3f1b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:50.936017 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-1616e63c-62b6-4bf3-9e18-ad01610a3f1b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1514 microversion: 2.1 time: 0.301883 Sep 01 14:06:50.942956 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 58/118] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:50 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1514 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:50.950749 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-1ffff06a-88c9-4411-bafa-04414ad5d0d2 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:50.951670 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-1ffff06a-88c9-4411-bafa-04414ad5d0d2 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:50.959618 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1ffff06a-88c9-4411-bafa-04414ad5d0d2 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:50.960586 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1ffff06a-88c9-4411-bafa-04414ad5d0d2 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:50.992423 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-16fe8a0d-d71a-48c3-b9f7-73c47e1d25fe tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:06:50.993842 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1ffff06a-88c9-4411-bafa-04414ad5d0d2 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:50.994643 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1ffff06a-88c9-4411-bafa-04414ad5d0d2 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:51.001510 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1ffff06a-88c9-4411-bafa-04414ad5d0d2 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:51.004621 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1ffff06a-88c9-4411-bafa-04414ad5d0d2 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:51.011864 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-16fe8a0d-d71a-48c3-b9f7-73c47e1d25fe tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:51.045828 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-16fe8a0d-d71a-48c3-b9f7-73c47e1d25fe tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:51.048812 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-16fe8a0d-d71a-48c3-b9f7-73c47e1d25fe tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:51.052149 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-16fe8a0d-d71a-48c3-b9f7-73c47e1d25fe tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:51.055017 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-16fe8a0d-d71a-48c3-b9f7-73c47e1d25fe tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:51.059555 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-16fe8a0d-d71a-48c3-b9f7-73c47e1d25fe tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:51.060934 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-16fe8a0d-d71a-48c3-b9f7-73c47e1d25fe tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:51.214380 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.objects.instance [None req-16fe8a0d-d71a-48c3-b9f7-73c47e1d25fe tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lazy-loading 'flavor' on Instance uuid 4c1dec77-467a-4bb0-802c-6d7373f0aca5 {{(pid=121339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:06:51.238999 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-1ffff06a-88c9-4411-bafa-04414ad5d0d2 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:51.249682 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-1ffff06a-88c9-4411-bafa-04414ad5d0d2 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:51.251381 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-1ffff06a-88c9-4411-bafa-04414ad5d0d2 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:51.253579 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-1ffff06a-88c9-4411-bafa-04414ad5d0d2 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1600 microversion: 2.20 time: 0.310704 Sep 01 14:06:51.254752 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 61/119] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:06:50 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1600 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:06:51.262524 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [req-45251c42-3b40-41a6-b9fe-fe059202be54 req-236ab1e6-95d4-4144-982b-23437de8defe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c2b8351-0db7-45ab-848a-1e339e67bcf7", "name": "network-vif-plugged", "status": "completed", "tag": "39a55af7-1a2a-41f8-b092-76d3ddca0161"}]} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:06:51.274519 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-45251c42-3b40-41a6-b9fe-fe059202be54 req-236ab1e6-95d4-4144-982b-23437de8defe service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:51.275384 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-45251c42-3b40-41a6-b9fe-fe059202be54 req-236ab1e6-95d4-4144-982b-23437de8defe service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:51.276831 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-45251c42-3b40-41a6-b9fe-fe059202be54 req-236ab1e6-95d4-4144-982b-23437de8defe service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:51.298036 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.compute.server_external_events [req-45251c42-3b40-41a6-b9fe-fe059202be54 req-236ab1e6-95d4-4144-982b-23437de8defe service nova] Creating event network-vif-plugged:39a55af7-1a2a-41f8-b092-76d3ddca0161 for instance 1c2b8351-0db7-45ab-848a-1e339e67bcf7 on hv-cinder-85221 Sep 01 14:06:51.306778 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [req-45251c42-3b40-41a6-b9fe-fe059202be54 req-236ab1e6-95d4-4144-982b-23437de8defe service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049269 Sep 01 14:06:51.307920 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 62/120] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:06:51.315680 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-d9f5bfeb-515e-4930-9c05-f3b03d356b6a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:51.316328 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-d9f5bfeb-515e-4930-9c05-f3b03d356b6a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:51.328275 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d9f5bfeb-515e-4930-9c05-f3b03d356b6a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:51.329390 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d9f5bfeb-515e-4930-9c05-f3b03d356b6a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:51.331527 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d9f5bfeb-515e-4930-9c05-f3b03d356b6a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:51.333070 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d9f5bfeb-515e-4930-9c05-f3b03d356b6a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:51.334125 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d9f5bfeb-515e-4930-9c05-f3b03d356b6a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:51.336332 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d9f5bfeb-515e-4930-9c05-f3b03d356b6a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:51.431486 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-d9f5bfeb-515e-4930-9c05-f3b03d356b6a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.121794 Sep 01 14:06:51.433775 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 63/121] 10.222.0.25 () {60 vars in 1316 bytes} [Thu Sep 1 14:06:51 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71/os-interface => generated 284 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 14:06:51.719826 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-7c283c23-5eb7-425e-8e3b-cbdc1fb5deed tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:51.722816 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-7c283c23-5eb7-425e-8e3b-cbdc1fb5deed tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:51.733632 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7c283c23-5eb7-425e-8e3b-cbdc1fb5deed tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:51.735115 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7c283c23-5eb7-425e-8e3b-cbdc1fb5deed tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:51.736025 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7c283c23-5eb7-425e-8e3b-cbdc1fb5deed tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:51.738036 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7c283c23-5eb7-425e-8e3b-cbdc1fb5deed tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:51.739243 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7c283c23-5eb7-425e-8e3b-cbdc1fb5deed tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:51.743004 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7c283c23-5eb7-425e-8e3b-cbdc1fb5deed tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:51.907498 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-16fe8a0d-d71a-48c3-b9f7-73c47e1d25fe tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "POST /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5/action" status: 200 len: 32 microversion: 2.1 time: 0.938766 Sep 01 14:06:51.917461 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 59/122] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Sep 1 14:06:50 2022] POST /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5/action => generated 32 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 14:06:51.924023 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-234fcdec-9e7c-43f0-aea0-e6ac07d151e0 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:51.925131 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-234fcdec-9e7c-43f0-aea0-e6ac07d151e0 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:51.933228 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-234fcdec-9e7c-43f0-aea0-e6ac07d151e0 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:51.933783 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-234fcdec-9e7c-43f0-aea0-e6ac07d151e0 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:51.934253 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-234fcdec-9e7c-43f0-aea0-e6ac07d151e0 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:51.934967 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-234fcdec-9e7c-43f0-aea0-e6ac07d151e0 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:51.935417 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-234fcdec-9e7c-43f0-aea0-e6ac07d151e0 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:51.935826 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-234fcdec-9e7c-43f0-aea0-e6ac07d151e0 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:52.301861 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-7c283c23-5eb7-425e-8e3b-cbdc1fb5deed tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:52.325241 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-7c283c23-5eb7-425e-8e3b-cbdc1fb5deed tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1363 microversion: 2.1 time: 0.611963 Sep 01 14:06:52.328522 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 64/123] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:51 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1363 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:06:52.577248 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-234fcdec-9e7c-43f0-aea0-e6ac07d151e0 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:52.599567 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-234fcdec-9e7c-43f0-aea0-e6ac07d151e0 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1520 microversion: 2.1 time: 0.680591 Sep 01 14:06:52.619170 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 60/124] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:51 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1520 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:06:53.377264 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-3c469c3d-705c-45f5-a5a6-cc6c964f3892 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:53.378384 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-3c469c3d-705c-45f5-a5a6-cc6c964f3892 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:53.397152 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_api:SELECT=88 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:53.402516 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3c469c3d-705c-45f5-a5a6-cc6c964f3892 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:53.404099 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3c469c3d-705c-45f5-a5a6-cc6c964f3892 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:53.408411 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3c469c3d-705c-45f5-a5a6-cc6c964f3892 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:53.411330 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3c469c3d-705c-45f5-a5a6-cc6c964f3892 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:53.413877 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3c469c3d-705c-45f5-a5a6-cc6c964f3892 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:53.423076 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3c469c3d-705c-45f5-a5a6-cc6c964f3892 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:53.646153 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-0d8126e4-e743-40d4-8b21-a3783d4a9f5e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:53.654099 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-0d8126e4-e743-40d4-8b21-a3783d4a9f5e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:53.674431 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0d8126e4-e743-40d4-8b21-a3783d4a9f5e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:53.675358 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0d8126e4-e743-40d4-8b21-a3783d4a9f5e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:53.676376 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0d8126e4-e743-40d4-8b21-a3783d4a9f5e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:53.677666 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0d8126e4-e743-40d4-8b21-a3783d4a9f5e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:53.678516 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0d8126e4-e743-40d4-8b21-a3783d4a9f5e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:53.679271 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0d8126e4-e743-40d4-8b21-a3783d4a9f5e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:53.954586 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-3c469c3d-705c-45f5-a5a6-cc6c964f3892 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:53.972853 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-3c469c3d-705c-45f5-a5a6-cc6c964f3892 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1363 microversion: 2.1 time: 0.616168 Sep 01 14:06:53.974557 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 65/125] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:53 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1363 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:54.277380 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-0d8126e4-e743-40d4-8b21-a3783d4a9f5e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:54.302336 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-0d8126e4-e743-40d4-8b21-a3783d4a9f5e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1520 microversion: 2.1 time: 0.653380 Sep 01 14:06:54.302336 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 61/126] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:53 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1520 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:54.461772 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [req-deb9ee9b-ae76-40f8-a5f0-2293217a1a5b req-91309f10-f866-42ac-aea2-cab2dc5b78b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d39f7090-b419-46be-9fcc-7ae73004ab71", "tag": "9ae4ab09-714c-4175-ba0d-7b76b31e652d"}]} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:06:54.473166 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-deb9ee9b-ae76-40f8-a5f0-2293217a1a5b req-91309f10-f866-42ac-aea2-cab2dc5b78b7 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:54.473166 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-deb9ee9b-ae76-40f8-a5f0-2293217a1a5b req-91309f10-f866-42ac-aea2-cab2dc5b78b7 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:54.473506 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-deb9ee9b-ae76-40f8-a5f0-2293217a1a5b req-91309f10-f866-42ac-aea2-cab2dc5b78b7 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:54.492208 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.compute.server_external_events [req-deb9ee9b-ae76-40f8-a5f0-2293217a1a5b req-91309f10-f866-42ac-aea2-cab2dc5b78b7 service nova] Creating event network-changed:9ae4ab09-714c-4175-ba0d-7b76b31e652d for instance d39f7090-b419-46be-9fcc-7ae73004ab71 on hv-cinder-85221 Sep 01 14:06:54.497892 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [req-deb9ee9b-ae76-40f8-a5f0-2293217a1a5b req-91309f10-f866-42ac-aea2-cab2dc5b78b7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040173 Sep 01 14:06:54.502050 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 66/127] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:06:55.016412 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-db42a3e7-3e91-4a5f-b337-2544a3585a3a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:55.017092 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-db42a3e7-3e91-4a5f-b337-2544a3585a3a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:55.030241 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-db42a3e7-3e91-4a5f-b337-2544a3585a3a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:55.032039 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-db42a3e7-3e91-4a5f-b337-2544a3585a3a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:55.032497 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-db42a3e7-3e91-4a5f-b337-2544a3585a3a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:55.038197 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-db42a3e7-3e91-4a5f-b337-2544a3585a3a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:55.040704 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-db42a3e7-3e91-4a5f-b337-2544a3585a3a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:55.041525 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-db42a3e7-3e91-4a5f-b337-2544a3585a3a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:55.317703 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-6cecba06-4a98-4501-8bdc-e53d406ab195 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:55.318606 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-6cecba06-4a98-4501-8bdc-e53d406ab195 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:55.331785 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6cecba06-4a98-4501-8bdc-e53d406ab195 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:55.332352 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6cecba06-4a98-4501-8bdc-e53d406ab195 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:55.332790 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6cecba06-4a98-4501-8bdc-e53d406ab195 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:55.333604 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6cecba06-4a98-4501-8bdc-e53d406ab195 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:55.334165 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6cecba06-4a98-4501-8bdc-e53d406ab195 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:55.334691 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6cecba06-4a98-4501-8bdc-e53d406ab195 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:55.589021 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-db42a3e7-3e91-4a5f-b337-2544a3585a3a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:55.604030 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:55.622720 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-db42a3e7-3e91-4a5f-b337-2544a3585a3a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1549 microversion: 2.1 time: 0.611540 Sep 01 14:06:55.634499 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 62/128] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:55 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1549 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:55.650328 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-4593ce69-a1bc-4159-ad36-2383a4f86b64 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:55.651085 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-4593ce69-a1bc-4159-ad36-2383a4f86b64 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:55.657962 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4593ce69-a1bc-4159-ad36-2383a4f86b64 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:55.659486 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4593ce69-a1bc-4159-ad36-2383a4f86b64 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:55.660096 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4593ce69-a1bc-4159-ad36-2383a4f86b64 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:55.660980 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4593ce69-a1bc-4159-ad36-2383a4f86b64 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:55.661597 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4593ce69-a1bc-4159-ad36-2383a4f86b64 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:55.662214 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4593ce69-a1bc-4159-ad36-2383a4f86b64 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:55.877468 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-6cecba06-4a98-4501-8bdc-e53d406ab195 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:55.893768 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-6cecba06-4a98-4501-8bdc-e53d406ab195 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1520 microversion: 2.1 time: 0.576881 Sep 01 14:06:55.893768 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 67/129] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:55 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1520 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:06:55.924348 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-4593ce69-a1bc-4159-ad36-2383a4f86b64 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.278316 Sep 01 14:06:55.932190 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 63/130] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Sep 1 14:06:55 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7/os-interface => generated 285 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:06:56.918350 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-99ab44e9-44db-4a54-a061-a1b8dda6100b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:56.920865 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-99ab44e9-44db-4a54-a061-a1b8dda6100b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:56.937480 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-99ab44e9-44db-4a54-a061-a1b8dda6100b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:56.938414 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-99ab44e9-44db-4a54-a061-a1b8dda6100b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:56.940137 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-99ab44e9-44db-4a54-a061-a1b8dda6100b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:56.941367 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-99ab44e9-44db-4a54-a061-a1b8dda6100b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:56.942586 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-99ab44e9-44db-4a54-a061-a1b8dda6100b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:56.943312 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-99ab44e9-44db-4a54-a061-a1b8dda6100b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:57.303211 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-99ab44e9-44db-4a54-a061-a1b8dda6100b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:57.313204 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-99ab44e9-44db-4a54-a061-a1b8dda6100b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1520 microversion: 2.1 time: 0.402251 Sep 01 14:06:57.313888 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 68/131] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:56 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1520 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:57.999419 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [req-e00ae827-9281-4573-a060-e8199f9677e2 req-68e7e92a-23c7-4fa6-b4fc-4988f2df9da5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c2b8351-0db7-45ab-848a-1e339e67bcf7", "tag": "39a55af7-1a2a-41f8-b092-76d3ddca0161"}]} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:06:58.013085 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-e00ae827-9281-4573-a060-e8199f9677e2 req-68e7e92a-23c7-4fa6-b4fc-4988f2df9da5 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:58.015248 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-e00ae827-9281-4573-a060-e8199f9677e2 req-68e7e92a-23c7-4fa6-b4fc-4988f2df9da5 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:58.015248 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-e00ae827-9281-4573-a060-e8199f9677e2 req-68e7e92a-23c7-4fa6-b4fc-4988f2df9da5 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:58.029005 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.compute.server_external_events [req-e00ae827-9281-4573-a060-e8199f9677e2 req-68e7e92a-23c7-4fa6-b4fc-4988f2df9da5 service nova] Creating event network-changed:39a55af7-1a2a-41f8-b092-76d3ddca0161 for instance 1c2b8351-0db7-45ab-848a-1e339e67bcf7 on hv-cinder-85221 Sep 01 14:06:58.035664 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [req-e00ae827-9281-4573-a060-e8199f9677e2 req-68e7e92a-23c7-4fa6-b4fc-4988f2df9da5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040884 Sep 01 14:06:58.037012 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 64/132] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:06:58.340736 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-6f88c1d4-5450-4048-81fb-9b872968dde0 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:58.340736 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-6f88c1d4-5450-4048-81fb-9b872968dde0 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:58.357430 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6f88c1d4-5450-4048-81fb-9b872968dde0 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:58.359609 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6f88c1d4-5450-4048-81fb-9b872968dde0 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:58.360161 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6f88c1d4-5450-4048-81fb-9b872968dde0 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:58.361285 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6f88c1d4-5450-4048-81fb-9b872968dde0 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:58.367296 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6f88c1d4-5450-4048-81fb-9b872968dde0 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:58.371674 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6f88c1d4-5450-4048-81fb-9b872968dde0 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:58.800017 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-6f88c1d4-5450-4048-81fb-9b872968dde0 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:58.811975 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-6f88c1d4-5450-4048-81fb-9b872968dde0 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1520 microversion: 2.1 time: 0.477081 Sep 01 14:06:58.827316 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 69/133] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:58 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1520 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:59.836734 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-a1a93710-851b-486d-abd5-e5272acb613b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:59.838039 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-a1a93710-851b-486d-abd5-e5272acb613b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:59.860481 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a1a93710-851b-486d-abd5-e5272acb613b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:59.861702 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a1a93710-851b-486d-abd5-e5272acb613b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:59.862414 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a1a93710-851b-486d-abd5-e5272acb613b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:59.866028 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a1a93710-851b-486d-abd5-e5272acb613b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:59.866784 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a1a93710-851b-486d-abd5-e5272acb613b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:59.867220 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a1a93710-851b-486d-abd5-e5272acb613b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:00.097736 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-a1a93710-851b-486d-abd5-e5272acb613b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:00.108779 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-a1a93710-851b-486d-abd5-e5272acb613b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1520 microversion: 2.1 time: 0.276391 Sep 01 14:07:00.121931 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 65/134] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:59 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1520 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:07:00.488117 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-b9757311-764d-4397-9119-ffc222ef3e67 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:00.488945 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-b9757311-764d-4397-9119-ffc222ef3e67 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] [instance: 3000b992-fcbf-472e-a1e0-11b101af43a7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:00.499969 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b9757311-764d-4397-9119-ffc222ef3e67 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:00.501226 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b9757311-764d-4397-9119-ffc222ef3e67 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:00.501990 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b9757311-764d-4397-9119-ffc222ef3e67 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:00.503804 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b9757311-764d-4397-9119-ffc222ef3e67 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:00.504838 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b9757311-764d-4397-9119-ffc222ef3e67 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:00.505810 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b9757311-764d-4397-9119-ffc222ef3e67 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:00.570213 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-b9757311-764d-4397-9119-ffc222ef3e67 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] [instance: 3000b992-fcbf-472e-a1e0-11b101af43a7] Going to try to terminate instance {{(pid=121340) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:07:01.034313 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-b9757311-764d-4397-9119-ffc222ef3e67 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7" status: 204 len: 0 microversion: 2.1 time: 0.553766 Sep 01 14:07:01.039713 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 70/135] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 14:07:00 2022] DELETE /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:07:01.055897 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-91c6f441-bc45-4786-9bec-69a645805ff1 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:01.057245 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-91c6f441-bc45-4786-9bec-69a645805ff1 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] [instance: 3000b992-fcbf-472e-a1e0-11b101af43a7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:01.066667 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_api:SELECT=76 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:01.074313 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-91c6f441-bc45-4786-9bec-69a645805ff1 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:01.075037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-91c6f441-bc45-4786-9bec-69a645805ff1 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:01.075707 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-91c6f441-bc45-4786-9bec-69a645805ff1 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:01.077042 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-91c6f441-bc45-4786-9bec-69a645805ff1 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:01.077814 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-91c6f441-bc45-4786-9bec-69a645805ff1 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:01.078559 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-91c6f441-bc45-4786-9bec-69a645805ff1 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:01.133578 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-03b8dff8-1989-4515-a4f0-30e71021cf27 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:01.134410 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-03b8dff8-1989-4515-a4f0-30e71021cf27 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:01.141323 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-03b8dff8-1989-4515-a4f0-30e71021cf27 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:01.141814 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-03b8dff8-1989-4515-a4f0-30e71021cf27 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:01.142710 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-03b8dff8-1989-4515-a4f0-30e71021cf27 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:01.143240 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-03b8dff8-1989-4515-a4f0-30e71021cf27 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:01.143713 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-03b8dff8-1989-4515-a4f0-30e71021cf27 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:01.144141 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-03b8dff8-1989-4515-a4f0-30e71021cf27 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:01.423255 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-91c6f441-bc45-4786-9bec-69a645805ff1 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b991f5024e4b5dbe8510b7381b1dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f871b0e1d3154b6d8c297b12ae738be0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:01.438468 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-91c6f441-bc45-4786-9bec-69a645805ff1 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] 10.222.0.25 "GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7" status: 200 len: 1555 microversion: 2.1 time: 0.395055 Sep 01 14:07:01.440057 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 66/136] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:01 2022] GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7 => generated 1555 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:01.445197 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-03b8dff8-1989-4515-a4f0-30e71021cf27 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:01.463438 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-03b8dff8-1989-4515-a4f0-30e71021cf27 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1520 microversion: 2.1 time: 0.333543 Sep 01 14:07:01.466314 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 71/137] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:01 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1520 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:07:02.478079 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-e51de293-f5ac-41bd-8f97-41c60e25a228 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:02.479144 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-e51de293-f5ac-41bd-8f97-41c60e25a228 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] [instance: 3000b992-fcbf-472e-a1e0-11b101af43a7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:02.486213 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-e25caccc-b7a7-4eae-a6be-106a7d790eed tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:02.487051 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-e25caccc-b7a7-4eae-a6be-106a7d790eed tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:02.491575 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e51de293-f5ac-41bd-8f97-41c60e25a228 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:02.492395 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e51de293-f5ac-41bd-8f97-41c60e25a228 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:02.494135 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e51de293-f5ac-41bd-8f97-41c60e25a228 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:02.494778 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e25caccc-b7a7-4eae-a6be-106a7d790eed tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:02.494866 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e51de293-f5ac-41bd-8f97-41c60e25a228 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:02.494941 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e25caccc-b7a7-4eae-a6be-106a7d790eed tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:02.495324 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e25caccc-b7a7-4eae-a6be-106a7d790eed tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:02.495559 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e51de293-f5ac-41bd-8f97-41c60e25a228 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:02.495991 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e51de293-f5ac-41bd-8f97-41c60e25a228 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:02.496089 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e25caccc-b7a7-4eae-a6be-106a7d790eed tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:02.496508 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e25caccc-b7a7-4eae-a6be-106a7d790eed tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:02.497159 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e25caccc-b7a7-4eae-a6be-106a7d790eed tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:02.804429 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-e25caccc-b7a7-4eae-a6be-106a7d790eed tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:02.818628 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-e25caccc-b7a7-4eae-a6be-106a7d790eed tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1520 microversion: 2.1 time: 0.336015 Sep 01 14:07:02.818837 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-e51de293-f5ac-41bd-8f97-41c60e25a228 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b991f5024e4b5dbe8510b7381b1dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f871b0e1d3154b6d8c297b12ae738be0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:02.819869 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 72/138] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:02 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1520 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:07:02.851956 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-e51de293-f5ac-41bd-8f97-41c60e25a228 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] 10.222.0.25 "GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7" status: 200 len: 1555 microversion: 2.1 time: 0.379973 Sep 01 14:07:02.853326 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 67/139] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:02 2022] GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7 => generated 1555 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:07:03.863602 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-e2c87142-c1bf-4a53-ab5f-497a2f1dea82 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:03.864905 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-e2c87142-c1bf-4a53-ab5f-497a2f1dea82 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:03.879378 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e2c87142-c1bf-4a53-ab5f-497a2f1dea82 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:03.880634 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e2c87142-c1bf-4a53-ab5f-497a2f1dea82 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:03.893844 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-051175ff-4e56-46e6-809f-1c9cbe84ced9 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:03.895171 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e2c87142-c1bf-4a53-ab5f-497a2f1dea82 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:03.895290 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-051175ff-4e56-46e6-809f-1c9cbe84ced9 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] [instance: 3000b992-fcbf-472e-a1e0-11b101af43a7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:03.895408 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e2c87142-c1bf-4a53-ab5f-497a2f1dea82 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:03.895408 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e2c87142-c1bf-4a53-ab5f-497a2f1dea82 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:03.895408 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e2c87142-c1bf-4a53-ab5f-497a2f1dea82 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:03.895633 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-051175ff-4e56-46e6-809f-1c9cbe84ced9 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:03.895633 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-051175ff-4e56-46e6-809f-1c9cbe84ced9 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:03.895633 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-051175ff-4e56-46e6-809f-1c9cbe84ced9 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:03.895633 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-051175ff-4e56-46e6-809f-1c9cbe84ced9 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:03.896032 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-051175ff-4e56-46e6-809f-1c9cbe84ced9 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:03.896032 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-051175ff-4e56-46e6-809f-1c9cbe84ced9 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:03.911137 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:04.258804 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-e2c87142-c1bf-4a53-ab5f-497a2f1dea82 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:04.287926 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-e2c87142-c1bf-4a53-ab5f-497a2f1dea82 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1520 microversion: 2.1 time: 0.432773 Sep 01 14:07:04.289037 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 73/140] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:03 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1520 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:04.375039 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-051175ff-4e56-46e6-809f-1c9cbe84ced9 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b991f5024e4b5dbe8510b7381b1dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f871b0e1d3154b6d8c297b12ae738be0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:04.409497 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-051175ff-4e56-46e6-809f-1c9cbe84ced9 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] 10.222.0.25 "GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7" status: 200 len: 1555 microversion: 2.1 time: 0.528322 Sep 01 14:07:04.413097 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 68/141] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:03 2022] GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7 => generated 1555 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:04.732514 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [req-ef6a832f-4f9a-44cb-aae0-025f17de7c3e req-4343b55c-1674-4b83-88c4-751481ea8d24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3000b992-fcbf-472e-a1e0-11b101af43a7", "name": "network-vif-deleted", "tag": "c244d57b-8a64-435a-8910-dd80fa1b3bd5"}]} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:07:04.748038 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-ef6a832f-4f9a-44cb-aae0-025f17de7c3e req-4343b55c-1674-4b83-88c4-751481ea8d24 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:04.748631 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-ef6a832f-4f9a-44cb-aae0-025f17de7c3e req-4343b55c-1674-4b83-88c4-751481ea8d24 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:04.749519 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-ef6a832f-4f9a-44cb-aae0-025f17de7c3e req-4343b55c-1674-4b83-88c4-751481ea8d24 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:04.770971 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.compute.server_external_events [req-ef6a832f-4f9a-44cb-aae0-025f17de7c3e req-4343b55c-1674-4b83-88c4-751481ea8d24 service nova] Creating event network-vif-deleted:c244d57b-8a64-435a-8910-dd80fa1b3bd5 for instance 3000b992-fcbf-472e-a1e0-11b101af43a7 on hv-cinder-85221 Sep 01 14:07:04.779454 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [req-ef6a832f-4f9a-44cb-aae0-025f17de7c3e req-4343b55c-1674-4b83-88c4-751481ea8d24 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051055 Sep 01 14:07:04.781099 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 74/142] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:07:05.328921 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-26222579-6ed1-493c-808c-1d868f1a095c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:05.329803 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-26222579-6ed1-493c-808c-1d868f1a095c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:05.338014 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-26222579-6ed1-493c-808c-1d868f1a095c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:05.341097 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-26222579-6ed1-493c-808c-1d868f1a095c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:05.341097 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-26222579-6ed1-493c-808c-1d868f1a095c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:05.341097 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-26222579-6ed1-493c-808c-1d868f1a095c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:05.341097 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-26222579-6ed1-493c-808c-1d868f1a095c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:05.341681 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-26222579-6ed1-493c-808c-1d868f1a095c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:05.450204 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-d0c47f3e-b33e-479b-a9c4-45644a4337e8 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:05.452328 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-d0c47f3e-b33e-479b-a9c4-45644a4337e8 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] [instance: 3000b992-fcbf-472e-a1e0-11b101af43a7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:05.489394 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d0c47f3e-b33e-479b-a9c4-45644a4337e8 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:05.490408 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d0c47f3e-b33e-479b-a9c4-45644a4337e8 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:05.492495 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d0c47f3e-b33e-479b-a9c4-45644a4337e8 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:05.492495 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d0c47f3e-b33e-479b-a9c4-45644a4337e8 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:05.493141 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d0c47f3e-b33e-479b-a9c4-45644a4337e8 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:05.493916 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d0c47f3e-b33e-479b-a9c4-45644a4337e8 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:05.591215 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-26222579-6ed1-493c-808c-1d868f1a095c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:05.617879 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-26222579-6ed1-493c-808c-1d868f1a095c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1520 microversion: 2.1 time: 0.292806 Sep 01 14:07:05.619233 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 69/143] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:05 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1520 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:07:05.665373 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-d0c47f3e-b33e-479b-a9c4-45644a4337e8 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b991f5024e4b5dbe8510b7381b1dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f871b0e1d3154b6d8c297b12ae738be0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:05.682368 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-d0c47f3e-b33e-479b-a9c4-45644a4337e8 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] 10.222.0.25 "GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7" status: 200 len: 1346 microversion: 2.1 time: 0.236592 Sep 01 14:07:05.683815 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 75/144] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:05 2022] GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7 => generated 1346 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:06.646736 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-ccce9f0c-450c-4f3b-8beb-562ee325dfa9 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:06.647910 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-ccce9f0c-450c-4f3b-8beb-562ee325dfa9 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:06.656961 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ccce9f0c-450c-4f3b-8beb-562ee325dfa9 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:06.657663 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ccce9f0c-450c-4f3b-8beb-562ee325dfa9 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:06.658302 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ccce9f0c-450c-4f3b-8beb-562ee325dfa9 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:06.659515 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ccce9f0c-450c-4f3b-8beb-562ee325dfa9 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:06.660191 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ccce9f0c-450c-4f3b-8beb-562ee325dfa9 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:06.660770 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ccce9f0c-450c-4f3b-8beb-562ee325dfa9 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:06.709624 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-adeaae40-c6bd-45be-8d40-0d51fc156298 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:06.710757 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-adeaae40-c6bd-45be-8d40-0d51fc156298 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] [instance: 3000b992-fcbf-472e-a1e0-11b101af43a7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:06.744665 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-adeaae40-c6bd-45be-8d40-0d51fc156298 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:06.745834 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-adeaae40-c6bd-45be-8d40-0d51fc156298 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:06.747436 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-adeaae40-c6bd-45be-8d40-0d51fc156298 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:06.749089 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-adeaae40-c6bd-45be-8d40-0d51fc156298 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:06.750211 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-adeaae40-c6bd-45be-8d40-0d51fc156298 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:06.751085 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-adeaae40-c6bd-45be-8d40-0d51fc156298 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:06.809872 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-adeaae40-c6bd-45be-8d40-0d51fc156298 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:06.810385 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-adeaae40-c6bd-45be-8d40-0d51fc156298 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:06.810811 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-adeaae40-c6bd-45be-8d40-0d51fc156298 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:06.811271 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.objects.instance [None req-adeaae40-c6bd-45be-8d40-0d51fc156298 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lazy-loading 'fault' on Instance uuid 3000b992-fcbf-472e-a1e0-11b101af43a7 {{(pid=121340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:07:06.908994 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-adeaae40-c6bd-45be-8d40-0d51fc156298 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5b991f5024e4b5dbe8510b7381b1dc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f871b0e1d3154b6d8c297b12ae738be0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:06.927366 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-adeaae40-c6bd-45be-8d40-0d51fc156298 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] 10.222.0.25 "GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7" status: 200 len: 1351 microversion: 2.1 time: 0.224599 Sep 01 14:07:06.937980 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 76/145] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:06 2022] GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7 => generated 1351 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:06.961412 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-ccce9f0c-450c-4f3b-8beb-562ee325dfa9 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:06.988133 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-ccce9f0c-450c-4f3b-8beb-562ee325dfa9 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1520 microversion: 2.1 time: 0.349468 Sep 01 14:07:06.992265 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 70/146] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:06 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1520 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:07:07.952050 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-d607dde1-4c6d-4800-b977-bddd1ed5d258 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:07.952831 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-d607dde1-4c6d-4800-b977-bddd1ed5d258 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] [instance: 3000b992-fcbf-472e-a1e0-11b101af43a7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:07.961052 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d607dde1-4c6d-4800-b977-bddd1ed5d258 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:07.961544 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d607dde1-4c6d-4800-b977-bddd1ed5d258 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:07.962015 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d607dde1-4c6d-4800-b977-bddd1ed5d258 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:07.962729 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d607dde1-4c6d-4800-b977-bddd1ed5d258 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:07.963184 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d607dde1-4c6d-4800-b977-bddd1ed5d258 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:07.963609 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d607dde1-4c6d-4800-b977-bddd1ed5d258 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:07.986598 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.wsgi [None req-d607dde1-4c6d-4800-b977-bddd1ed5d258 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] HTTP exception thrown: Instance 3000b992-fcbf-472e-a1e0-11b101af43a7 could not be found. Sep 01 14:07:07.991525 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-d607dde1-4c6d-4800-b977-bddd1ed5d258 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Request method failure captured: Sep 01 14:07:07.991525 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: request: GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7 HTTP/1.1 Sep 01 14:07:07.991525 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept: application/json Sep 01 14:07:07.991525 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept-Encoding: identity Sep 01 14:07:07.991525 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Connection: close Sep 01 14:07:07.991525 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Length: 0 Sep 01 14:07:07.991525 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Type: application/json Sep 01 14:07:07.991525 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Host: 10.222.0.25 Sep 01 14:07:07.991525 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Openstack-System-Scope: None Sep 01 14:07:07.991525 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: User-Agent: python-urllib3/1.26.12 Sep 01 14:07:07.991525 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Auth-Token: gAAAAABjELxCrozyR718JX8ltuq3a426ueSVpAM3pf1gXU2ew2jOpf4f3pZmk6s8gZvqVFNXWEv7Vvpe16YW7Fc5RrMhSDBzDZTUtQzN7CNpoopCILP82n2m7ybsr3lOP6dKzBzjQpkLQAJzQ54sE5ZysGtU4EsJf_A5fIRd8fftfH65eqkPqvg Sep 01 14:07:07.991525 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Id: None Sep 01 14:07:07.991525 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Name: None Sep 01 14:07:07.991525 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Identity-Status: Confirmed Sep 01 14:07:07.991525 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Is-Admin-Project: True Sep 01 14:07:07.991525 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Id: default Sep 01 14:07:07.991525 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Name: Default Sep 01 14:07:07.991525 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Id: f871b0e1d3154b6d8c297b12ae738be0 Sep 01 14:07:07.991525 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Name: tempest-DeleteServersTestJSON-794799560 Sep 01 14:07:07.991525 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Role: member,reader Sep 01 14:07:07.991525 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Roles: member,reader Sep 01 14:07:07.992962 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f871b0e1d3154b6d8c297b12ae738be0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f871b0e1d3154b6d8c297b12ae738be0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f871b0e1d3154b6d8c297b12ae738be0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f871b0e1d3154b6d8c297b12ae738be0"}]}] Sep 01 14:07:07.992962 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant: tempest-DeleteServersTestJSON-794799560 Sep 01 14:07:07.992962 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Id: f871b0e1d3154b6d8c297b12ae738be0 Sep 01 14:07:07.992962 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Name: tempest-DeleteServersTestJSON-794799560 Sep 01 14:07:07.992962 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User: tempest-DeleteServersTestJSON-794799560-project Sep 01 14:07:07.992962 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Id: default Sep 01 14:07:07.992962 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Name: Default Sep 01 14:07:07.992962 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Id: c5b991f5024e4b5dbe8510b7381b1dc8 Sep 01 14:07:07.992962 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Name: tempest-DeleteServersTestJSON-794799560-project Sep 01 14:07:07.992962 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: method: > Sep 01 14:07:07.992962 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: exception: Instance 3000b992-fcbf-472e-a1e0-11b101af43a7 could not be found. Sep 01 14:07:07.992962 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: action_args: {'id': '3000b992-fcbf-472e-a1e0-11b101af43a7'} Sep 01 14:07:07.993668 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:07:07.993668 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:07:07.993668 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:07:07.993668 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:07:07.993668 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:07:07.993668 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:07:07.993668 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:07:07.993668 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:07:07.993668 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:07:07.993668 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:07:07.993668 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3000b992-fcbf-472e-a1e0-11b101af43a7 could not be found. Sep 01 14:07:07.993668 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:07:07.993668 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:07:07.993668 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:07:07.993668 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:07:07.993668 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:07:07.993668 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:07:07.993668 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:07:07.993668 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:07:07.993668 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:07:07.994924 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:07:07.994924 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:07:07.994924 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:07:07.994924 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:07:07.994924 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:07:07.994924 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:07:07.994924 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:07:07.994924 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3000b992-fcbf-472e-a1e0-11b101af43a7 could not be found. Sep 01 14:07:07.994924 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:07:07.994924 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:07:07.994924 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:07:07.994924 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:07:07.994924 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:07:07.994924 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:07:07.994924 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:07:07.994924 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:07:07.994924 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3000b992-fcbf-472e-a1e0-11b101af43a7 could not be found. Sep 01 14:07:07.994924 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:07:07.996116 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-d607dde1-4c6d-4800-b977-bddd1ed5d258 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Returning 404 to user: Instance 3000b992-fcbf-472e-a1e0-11b101af43a7 could not be found. {{(pid=121340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:07:07.996116 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-d607dde1-4c6d-4800-b977-bddd1ed5d258 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] 10.222.0.25 "GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7" status: 404 len: 111 microversion: 2.1 time: 0.044991 Sep 01 14:07:07.996116 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 77/147] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:07 2022] GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:07:08.015024 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-85f44d85-bbf0-4131-8903-f00438a69800 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:08.015963 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-85f44d85-bbf0-4131-8903-f00438a69800 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:08.023672 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-85f44d85-bbf0-4131-8903-f00438a69800 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:08.024164 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-85f44d85-bbf0-4131-8903-f00438a69800 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:08.024630 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-85f44d85-bbf0-4131-8903-f00438a69800 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:08.025366 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-85f44d85-bbf0-4131-8903-f00438a69800 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:08.025819 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-85f44d85-bbf0-4131-8903-f00438a69800 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:08.026297 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-85f44d85-bbf0-4131-8903-f00438a69800 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:08.267300 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-1bb957a9-76b9-4ff7-bd8a-1f3f174c77aa tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:08.271569 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-1bb957a9-76b9-4ff7-bd8a-1f3f174c77aa tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] [instance: 3000b992-fcbf-472e-a1e0-11b101af43a7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:08.279538 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1bb957a9-76b9-4ff7-bd8a-1f3f174c77aa tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:08.280324 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1bb957a9-76b9-4ff7-bd8a-1f3f174c77aa tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:08.280913 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1bb957a9-76b9-4ff7-bd8a-1f3f174c77aa tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:08.281863 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1bb957a9-76b9-4ff7-bd8a-1f3f174c77aa tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:08.282523 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1bb957a9-76b9-4ff7-bd8a-1f3f174c77aa tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:08.285934 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-85f44d85-bbf0-4131-8903-f00438a69800 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:08.290112 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1bb957a9-76b9-4ff7-bd8a-1f3f174c77aa tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:08.297296 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-85f44d85-bbf0-4131-8903-f00438a69800 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1520 microversion: 2.1 time: 0.287535 Sep 01 14:07:08.297891 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 71/148] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:08 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1520 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:08.327746 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.wsgi [None req-1bb957a9-76b9-4ff7-bd8a-1f3f174c77aa tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] HTTP exception thrown: Instance 3000b992-fcbf-472e-a1e0-11b101af43a7 could not be found. Sep 01 14:07:08.332841 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-1bb957a9-76b9-4ff7-bd8a-1f3f174c77aa tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Request method failure captured: Sep 01 14:07:08.332841 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: request: GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7/os-volume_attachments HTTP/1.1 Sep 01 14:07:08.332841 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept: application/json Sep 01 14:07:08.332841 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept-Encoding: identity Sep 01 14:07:08.332841 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Connection: close Sep 01 14:07:08.332841 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Length: 0 Sep 01 14:07:08.332841 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Type: application/json Sep 01 14:07:08.332841 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Host: 10.222.0.25 Sep 01 14:07:08.332841 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Openstack-System-Scope: None Sep 01 14:07:08.332841 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: User-Agent: python-urllib3/1.26.12 Sep 01 14:07:08.332841 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Auth-Token: gAAAAABjELxCrozyR718JX8ltuq3a426ueSVpAM3pf1gXU2ew2jOpf4f3pZmk6s8gZvqVFNXWEv7Vvpe16YW7Fc5RrMhSDBzDZTUtQzN7CNpoopCILP82n2m7ybsr3lOP6dKzBzjQpkLQAJzQ54sE5ZysGtU4EsJf_A5fIRd8fftfH65eqkPqvg Sep 01 14:07:08.332841 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Id: None Sep 01 14:07:08.332841 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Name: None Sep 01 14:07:08.332841 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Identity-Status: Confirmed Sep 01 14:07:08.332841 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Is-Admin-Project: True Sep 01 14:07:08.332841 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Id: default Sep 01 14:07:08.332841 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Name: Default Sep 01 14:07:08.332841 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Id: f871b0e1d3154b6d8c297b12ae738be0 Sep 01 14:07:08.332841 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Name: tempest-DeleteServersTestJSON-794799560 Sep 01 14:07:08.332841 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Role: member,reader Sep 01 14:07:08.332841 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Roles: member,reader Sep 01 14:07:08.334654 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f871b0e1d3154b6d8c297b12ae738be0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f871b0e1d3154b6d8c297b12ae738be0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f871b0e1d3154b6d8c297b12ae738be0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f871b0e1d3154b6d8c297b12ae738be0"}]}] Sep 01 14:07:08.334654 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant: tempest-DeleteServersTestJSON-794799560 Sep 01 14:07:08.334654 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Id: f871b0e1d3154b6d8c297b12ae738be0 Sep 01 14:07:08.334654 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Name: tempest-DeleteServersTestJSON-794799560 Sep 01 14:07:08.334654 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User: tempest-DeleteServersTestJSON-794799560-project Sep 01 14:07:08.334654 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Id: default Sep 01 14:07:08.334654 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Name: Default Sep 01 14:07:08.334654 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Id: c5b991f5024e4b5dbe8510b7381b1dc8 Sep 01 14:07:08.334654 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Name: tempest-DeleteServersTestJSON-794799560-project Sep 01 14:07:08.334654 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: method: > Sep 01 14:07:08.334654 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: exception: Instance 3000b992-fcbf-472e-a1e0-11b101af43a7 could not be found. Sep 01 14:07:08.334654 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: action_args: {'server_id': '3000b992-fcbf-472e-a1e0-11b101af43a7'} Sep 01 14:07:08.335631 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:07:08.335631 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:07:08.335631 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:07:08.335631 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:07:08.335631 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:07:08.335631 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:07:08.335631 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:07:08.335631 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:07:08.335631 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:07:08.335631 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:07:08.335631 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3000b992-fcbf-472e-a1e0-11b101af43a7 could not be found. Sep 01 14:07:08.335631 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:07:08.335631 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:07:08.335631 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:07:08.335631 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:07:08.335631 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:07:08.335631 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:07:08.335631 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:07:08.335631 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:07:08.335631 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:07:08.336825 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:07:08.336825 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 14:07:08.336825 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 14:07:08.336825 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 14:07:08.336825 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 14:07:08.336825 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 01 14:07:08.336825 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 01 14:07:08.336825 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:07:08.336825 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:07:08.336825 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3000b992-fcbf-472e-a1e0-11b101af43a7 could not be found. Sep 01 14:07:08.336825 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:07:08.336825 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:07:08.336825 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:07:08.336825 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:07:08.336825 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:07:08.336825 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:07:08.336825 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:07:08.336825 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:07:08.336825 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3000b992-fcbf-472e-a1e0-11b101af43a7 could not be found. Sep 01 14:07:08.336825 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:07:08.337984 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-1bb957a9-76b9-4ff7-bd8a-1f3f174c77aa tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Returning 404 to user: Instance 3000b992-fcbf-472e-a1e0-11b101af43a7 could not be found. {{(pid=121340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:07:08.337984 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-1bb957a9-76b9-4ff7-bd8a-1f3f174c77aa tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] 10.222.0.25 "GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.072385 Sep 01 14:07:08.337984 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 78/149] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 14:07:08 2022] GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7/os-volume_attachments => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 14:07:09.320253 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-f281d1fa-23a6-4485-b426-29d4052423c6 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:09.322991 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-f281d1fa-23a6-4485-b426-29d4052423c6 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:09.327314 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f281d1fa-23a6-4485-b426-29d4052423c6 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:09.327854 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f281d1fa-23a6-4485-b426-29d4052423c6 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:09.328262 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f281d1fa-23a6-4485-b426-29d4052423c6 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:09.328968 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f281d1fa-23a6-4485-b426-29d4052423c6 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:09.329412 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f281d1fa-23a6-4485-b426-29d4052423c6 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:09.331226 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f281d1fa-23a6-4485-b426-29d4052423c6 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:09.495058 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-f281d1fa-23a6-4485-b426-29d4052423c6 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:09.507904 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-f281d1fa-23a6-4485-b426-29d4052423c6 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1520 microversion: 2.1 time: 0.192061 Sep 01 14:07:09.513936 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 72/150] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:09 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:09.961472 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-61940d90-dfa3-410a-85ff-f849a27a2917 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:09.962226 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-61940d90-dfa3-410a-85ff-f849a27a2917 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] [instance: 3000b992-fcbf-472e-a1e0-11b101af43a7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:09.970518 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-61940d90-dfa3-410a-85ff-f849a27a2917 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:09.972552 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-61940d90-dfa3-410a-85ff-f849a27a2917 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:09.973009 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-61940d90-dfa3-410a-85ff-f849a27a2917 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:09.974067 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-61940d90-dfa3-410a-85ff-f849a27a2917 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:09.974818 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-61940d90-dfa3-410a-85ff-f849a27a2917 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:09.975560 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-61940d90-dfa3-410a-85ff-f849a27a2917 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:09.998462 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.wsgi [None req-61940d90-dfa3-410a-85ff-f849a27a2917 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] HTTP exception thrown: Instance 3000b992-fcbf-472e-a1e0-11b101af43a7 could not be found. Sep 01 14:07:10.000029 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-61940d90-dfa3-410a-85ff-f849a27a2917 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Request method failure captured: Sep 01 14:07:10.000029 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: request: DELETE /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7 HTTP/1.1 Sep 01 14:07:10.000029 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept: application/json Sep 01 14:07:10.000029 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept-Encoding: identity Sep 01 14:07:10.000029 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Connection: close Sep 01 14:07:10.000029 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Length: 0 Sep 01 14:07:10.000029 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Type: application/json Sep 01 14:07:10.000029 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Host: 10.222.0.25 Sep 01 14:07:10.000029 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Openstack-System-Scope: None Sep 01 14:07:10.000029 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: User-Agent: python-urllib3/1.26.12 Sep 01 14:07:10.000029 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Auth-Token: gAAAAABjELxCrozyR718JX8ltuq3a426ueSVpAM3pf1gXU2ew2jOpf4f3pZmk6s8gZvqVFNXWEv7Vvpe16YW7Fc5RrMhSDBzDZTUtQzN7CNpoopCILP82n2m7ybsr3lOP6dKzBzjQpkLQAJzQ54sE5ZysGtU4EsJf_A5fIRd8fftfH65eqkPqvg Sep 01 14:07:10.000029 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Id: None Sep 01 14:07:10.000029 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Name: None Sep 01 14:07:10.000029 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Identity-Status: Confirmed Sep 01 14:07:10.000029 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Is-Admin-Project: True Sep 01 14:07:10.000029 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Id: default Sep 01 14:07:10.000029 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Name: Default Sep 01 14:07:10.000029 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Id: f871b0e1d3154b6d8c297b12ae738be0 Sep 01 14:07:10.000029 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Name: tempest-DeleteServersTestJSON-794799560 Sep 01 14:07:10.000029 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Role: member,reader Sep 01 14:07:10.000029 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Roles: member,reader Sep 01 14:07:10.002366 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f871b0e1d3154b6d8c297b12ae738be0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f871b0e1d3154b6d8c297b12ae738be0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f871b0e1d3154b6d8c297b12ae738be0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f871b0e1d3154b6d8c297b12ae738be0"}]}] Sep 01 14:07:10.002366 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant: tempest-DeleteServersTestJSON-794799560 Sep 01 14:07:10.002366 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Id: f871b0e1d3154b6d8c297b12ae738be0 Sep 01 14:07:10.002366 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Name: tempest-DeleteServersTestJSON-794799560 Sep 01 14:07:10.002366 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User: tempest-DeleteServersTestJSON-794799560-project Sep 01 14:07:10.002366 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Id: default Sep 01 14:07:10.002366 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Name: Default Sep 01 14:07:10.002366 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Id: c5b991f5024e4b5dbe8510b7381b1dc8 Sep 01 14:07:10.002366 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Name: tempest-DeleteServersTestJSON-794799560-project Sep 01 14:07:10.002366 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: method: > Sep 01 14:07:10.002366 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: exception: Instance 3000b992-fcbf-472e-a1e0-11b101af43a7 could not be found. Sep 01 14:07:10.002366 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: action_args: {'id': '3000b992-fcbf-472e-a1e0-11b101af43a7'} Sep 01 14:07:10.003701 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:07:10.003701 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:07:10.003701 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:07:10.003701 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:07:10.003701 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:07:10.003701 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:07:10.003701 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:07:10.003701 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:07:10.003701 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:07:10.003701 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:07:10.003701 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3000b992-fcbf-472e-a1e0-11b101af43a7 could not be found. Sep 01 14:07:10.003701 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:07:10.003701 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:07:10.003701 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:07:10.003701 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:07:10.003701 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:07:10.003701 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:07:10.003701 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:07:10.003701 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:07:10.003701 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:07:10.005636 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:07:10.005636 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 14:07:10.005636 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 14:07:10.005636 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 14:07:10.005636 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 14:07:10.005636 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:07:10.005636 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:07:10.005636 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:07:10.005636 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:07:10.005636 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3000b992-fcbf-472e-a1e0-11b101af43a7 could not be found. Sep 01 14:07:10.005636 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:07:10.005636 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:07:10.005636 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:07:10.005636 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:07:10.005636 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:07:10.005636 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:07:10.005636 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:07:10.005636 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:07:10.005636 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3000b992-fcbf-472e-a1e0-11b101af43a7 could not be found. Sep 01 14:07:10.005636 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:07:10.008058 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-61940d90-dfa3-410a-85ff-f849a27a2917 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Returning 404 to user: Instance 3000b992-fcbf-472e-a1e0-11b101af43a7 could not be found. {{(pid=121340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:07:10.008058 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-61940d90-dfa3-410a-85ff-f849a27a2917 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7" status: 404 len: 111 microversion: 2.1 time: 0.044016 Sep 01 14:07:10.008058 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 79/151] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 14:07:09 2022] DELETE /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 14:07:10.012418 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-48572a9f-f87d-4e8b-a914-c05a472fffe4 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:10.013183 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-48572a9f-f87d-4e8b-a914-c05a472fffe4 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] [instance: 3000b992-fcbf-472e-a1e0-11b101af43a7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:10.024237 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-48572a9f-f87d-4e8b-a914-c05a472fffe4 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:10.024853 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-48572a9f-f87d-4e8b-a914-c05a472fffe4 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:10.025400 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-48572a9f-f87d-4e8b-a914-c05a472fffe4 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:10.026553 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-48572a9f-f87d-4e8b-a914-c05a472fffe4 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:10.027235 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-48572a9f-f87d-4e8b-a914-c05a472fffe4 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:10.042927 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-48572a9f-f87d-4e8b-a914-c05a472fffe4 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:10.044600 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.wsgi [None req-48572a9f-f87d-4e8b-a914-c05a472fffe4 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] HTTP exception thrown: Instance 3000b992-fcbf-472e-a1e0-11b101af43a7 could not be found. Sep 01 14:07:10.049748 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-48572a9f-f87d-4e8b-a914-c05a472fffe4 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Request method failure captured: Sep 01 14:07:10.049748 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: request: GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7 HTTP/1.1 Sep 01 14:07:10.049748 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept: application/json Sep 01 14:07:10.049748 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept-Encoding: identity Sep 01 14:07:10.049748 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Connection: close Sep 01 14:07:10.049748 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Length: 0 Sep 01 14:07:10.049748 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Type: application/json Sep 01 14:07:10.049748 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Host: 10.222.0.25 Sep 01 14:07:10.049748 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Openstack-System-Scope: None Sep 01 14:07:10.049748 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: User-Agent: python-urllib3/1.26.12 Sep 01 14:07:10.049748 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Auth-Token: gAAAAABjELxCrozyR718JX8ltuq3a426ueSVpAM3pf1gXU2ew2jOpf4f3pZmk6s8gZvqVFNXWEv7Vvpe16YW7Fc5RrMhSDBzDZTUtQzN7CNpoopCILP82n2m7ybsr3lOP6dKzBzjQpkLQAJzQ54sE5ZysGtU4EsJf_A5fIRd8fftfH65eqkPqvg Sep 01 14:07:10.049748 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Id: None Sep 01 14:07:10.049748 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Name: None Sep 01 14:07:10.049748 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Identity-Status: Confirmed Sep 01 14:07:10.049748 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Is-Admin-Project: True Sep 01 14:07:10.049748 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Id: default Sep 01 14:07:10.049748 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Name: Default Sep 01 14:07:10.049748 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Id: f871b0e1d3154b6d8c297b12ae738be0 Sep 01 14:07:10.049748 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Name: tempest-DeleteServersTestJSON-794799560 Sep 01 14:07:10.049748 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Role: member,reader Sep 01 14:07:10.049748 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Roles: member,reader Sep 01 14:07:10.052455 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f871b0e1d3154b6d8c297b12ae738be0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f871b0e1d3154b6d8c297b12ae738be0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f871b0e1d3154b6d8c297b12ae738be0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f871b0e1d3154b6d8c297b12ae738be0"}]}] Sep 01 14:07:10.052455 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant: tempest-DeleteServersTestJSON-794799560 Sep 01 14:07:10.052455 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Id: f871b0e1d3154b6d8c297b12ae738be0 Sep 01 14:07:10.052455 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Name: tempest-DeleteServersTestJSON-794799560 Sep 01 14:07:10.052455 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User: tempest-DeleteServersTestJSON-794799560-project Sep 01 14:07:10.052455 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Id: default Sep 01 14:07:10.052455 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Name: Default Sep 01 14:07:10.052455 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Id: c5b991f5024e4b5dbe8510b7381b1dc8 Sep 01 14:07:10.052455 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Name: tempest-DeleteServersTestJSON-794799560-project Sep 01 14:07:10.052455 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: method: > Sep 01 14:07:10.052455 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: exception: Instance 3000b992-fcbf-472e-a1e0-11b101af43a7 could not be found. Sep 01 14:07:10.052455 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: action_args: {'id': '3000b992-fcbf-472e-a1e0-11b101af43a7'} Sep 01 14:07:10.053870 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:07:10.053870 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:07:10.053870 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:07:10.053870 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:07:10.053870 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:07:10.053870 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:07:10.053870 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:07:10.053870 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:07:10.053870 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:07:10.053870 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:07:10.053870 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3000b992-fcbf-472e-a1e0-11b101af43a7 could not be found. Sep 01 14:07:10.053870 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:07:10.053870 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:07:10.053870 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:07:10.053870 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:07:10.053870 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:07:10.053870 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:07:10.053870 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:07:10.053870 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:07:10.053870 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:07:10.056073 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:07:10.056073 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:07:10.056073 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:07:10.056073 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:07:10.056073 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:07:10.056073 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:07:10.056073 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:07:10.056073 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3000b992-fcbf-472e-a1e0-11b101af43a7 could not be found. Sep 01 14:07:10.056073 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:07:10.056073 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:07:10.056073 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:07:10.056073 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:07:10.056073 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:07:10.056073 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:07:10.056073 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:07:10.056073 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:07:10.056073 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3000b992-fcbf-472e-a1e0-11b101af43a7 could not be found. Sep 01 14:07:10.056073 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:07:10.060254 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-48572a9f-f87d-4e8b-a914-c05a472fffe4 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] Returning 404 to user: Instance 3000b992-fcbf-472e-a1e0-11b101af43a7 could not be found. {{(pid=121339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:07:10.060254 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-48572a9f-f87d-4e8b-a914-c05a472fffe4 tempest-DeleteServersTestJSON-794799560 tempest-DeleteServersTestJSON-794799560-project] 10.222.0.25 "GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7" status: 404 len: 111 microversion: 2.1 time: 0.043537 Sep 01 14:07:10.060254 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 73/152] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:10 2022] GET /compute/v2.1/servers/3000b992-fcbf-472e-a1e0-11b101af43a7 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:07:10.538162 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-bb6bd63c-ba46-4fee-98e2-84b0d2bf057a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:10.538997 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-bb6bd63c-ba46-4fee-98e2-84b0d2bf057a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:10.570983 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bb6bd63c-ba46-4fee-98e2-84b0d2bf057a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:10.571884 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bb6bd63c-ba46-4fee-98e2-84b0d2bf057a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:10.572744 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bb6bd63c-ba46-4fee-98e2-84b0d2bf057a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:10.582851 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bb6bd63c-ba46-4fee-98e2-84b0d2bf057a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:10.584130 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bb6bd63c-ba46-4fee-98e2-84b0d2bf057a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:10.586144 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bb6bd63c-ba46-4fee-98e2-84b0d2bf057a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:11.046123 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-bb6bd63c-ba46-4fee-98e2-84b0d2bf057a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:11.087336 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-bb6bd63c-ba46-4fee-98e2-84b0d2bf057a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1520 microversion: 2.1 time: 0.555958 Sep 01 14:07:11.107943 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 80/153] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:10 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1520 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:12.131430 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-0a70808b-816e-4b07-a171-108d6ca9c88f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:12.132190 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-0a70808b-816e-4b07-a171-108d6ca9c88f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:12.141922 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0a70808b-816e-4b07-a171-108d6ca9c88f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:12.143261 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0a70808b-816e-4b07-a171-108d6ca9c88f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:12.144000 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0a70808b-816e-4b07-a171-108d6ca9c88f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:12.145298 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0a70808b-816e-4b07-a171-108d6ca9c88f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:12.146028 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0a70808b-816e-4b07-a171-108d6ca9c88f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:12.146584 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0a70808b-816e-4b07-a171-108d6ca9c88f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:12.319177 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-0a70808b-816e-4b07-a171-108d6ca9c88f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:12.334081 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-0a70808b-816e-4b07-a171-108d6ca9c88f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1520 microversion: 2.1 time: 0.203577 Sep 01 14:07:12.334081 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 74/154] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:12 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1520 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:13.352620 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-b6d91019-749d-4e9e-8566-089c267fc01e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:13.353426 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-b6d91019-749d-4e9e-8566-089c267fc01e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:13.364604 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b6d91019-749d-4e9e-8566-089c267fc01e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:13.368127 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b6d91019-749d-4e9e-8566-089c267fc01e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:13.370053 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b6d91019-749d-4e9e-8566-089c267fc01e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:13.371034 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b6d91019-749d-4e9e-8566-089c267fc01e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:13.372964 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b6d91019-749d-4e9e-8566-089c267fc01e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:13.374365 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b6d91019-749d-4e9e-8566-089c267fc01e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:13.760064 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-b6d91019-749d-4e9e-8566-089c267fc01e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:13.773976 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-b6d91019-749d-4e9e-8566-089c267fc01e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1520 microversion: 2.1 time: 0.424777 Sep 01 14:07:13.800724 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 81/155] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:13 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1520 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:14.833874 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-d0069c25-f2ad-47c5-ba52-18e367d3c482 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:14.835083 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-d0069c25-f2ad-47c5-ba52-18e367d3c482 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:14.846815 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d0069c25-f2ad-47c5-ba52-18e367d3c482 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:14.847760 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d0069c25-f2ad-47c5-ba52-18e367d3c482 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:14.848609 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d0069c25-f2ad-47c5-ba52-18e367d3c482 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:14.849871 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d0069c25-f2ad-47c5-ba52-18e367d3c482 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:14.852148 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d0069c25-f2ad-47c5-ba52-18e367d3c482 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:14.852909 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d0069c25-f2ad-47c5-ba52-18e367d3c482 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:15.145021 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-d0069c25-f2ad-47c5-ba52-18e367d3c482 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:15.168567 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-d0069c25-f2ad-47c5-ba52-18e367d3c482 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1520 microversion: 2.1 time: 0.342876 Sep 01 14:07:15.171074 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 75/156] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:14 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1520 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:16.201487 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-56eff4eb-f6dd-441c-a7bd-7c08ab524a86 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:16.206538 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-56eff4eb-f6dd-441c-a7bd-7c08ab524a86 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:16.234586 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-56eff4eb-f6dd-441c-a7bd-7c08ab524a86 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:16.235573 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-56eff4eb-f6dd-441c-a7bd-7c08ab524a86 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:16.237088 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-56eff4eb-f6dd-441c-a7bd-7c08ab524a86 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:16.245106 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-56eff4eb-f6dd-441c-a7bd-7c08ab524a86 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:16.245106 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-56eff4eb-f6dd-441c-a7bd-7c08ab524a86 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:16.246594 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-56eff4eb-f6dd-441c-a7bd-7c08ab524a86 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:16.563330 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-56eff4eb-f6dd-441c-a7bd-7c08ab524a86 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:16.584536 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-56eff4eb-f6dd-441c-a7bd-7c08ab524a86 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1520 microversion: 2.1 time: 0.395787 Sep 01 14:07:16.585884 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 82/157] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:16 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1520 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:17.612735 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-ddc2127b-798a-4b39-ad1a-252235780628 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:17.614091 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-ddc2127b-798a-4b39-ad1a-252235780628 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:17.624835 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ddc2127b-798a-4b39-ad1a-252235780628 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:17.625586 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ddc2127b-798a-4b39-ad1a-252235780628 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:17.626350 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ddc2127b-798a-4b39-ad1a-252235780628 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:17.633418 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ddc2127b-798a-4b39-ad1a-252235780628 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:17.633418 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ddc2127b-798a-4b39-ad1a-252235780628 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:17.633418 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ddc2127b-798a-4b39-ad1a-252235780628 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:17.848560 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-ddc2127b-798a-4b39-ad1a-252235780628 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:17.857704 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-ddc2127b-798a-4b39-ad1a-252235780628 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1520 microversion: 2.1 time: 0.251080 Sep 01 14:07:17.858331 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 76/158] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:17 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1520 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:18.882246 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-7be3a174-f26e-43b4-ac0f-93532f07b8a8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:18.883179 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-7be3a174-f26e-43b4-ac0f-93532f07b8a8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:18.891167 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7be3a174-f26e-43b4-ac0f-93532f07b8a8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:18.891794 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7be3a174-f26e-43b4-ac0f-93532f07b8a8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:18.892333 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7be3a174-f26e-43b4-ac0f-93532f07b8a8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:18.894181 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7be3a174-f26e-43b4-ac0f-93532f07b8a8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:18.895148 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7be3a174-f26e-43b4-ac0f-93532f07b8a8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:18.895953 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7be3a174-f26e-43b4-ac0f-93532f07b8a8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:19.135776 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-7be3a174-f26e-43b4-ac0f-93532f07b8a8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:19.142885 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-7be3a174-f26e-43b4-ac0f-93532f07b8a8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1520 microversion: 2.1 time: 0.266542 Sep 01 14:07:19.143638 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 83/159] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:18 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1520 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:07:20.179043 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-a342ad41-4d6a-432a-b4f3-ea8755a255a8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:20.180084 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-a342ad41-4d6a-432a-b4f3-ea8755a255a8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:20.187245 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a342ad41-4d6a-432a-b4f3-ea8755a255a8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:20.187963 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a342ad41-4d6a-432a-b4f3-ea8755a255a8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:20.188576 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a342ad41-4d6a-432a-b4f3-ea8755a255a8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:20.189530 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a342ad41-4d6a-432a-b4f3-ea8755a255a8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:20.190244 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a342ad41-4d6a-432a-b4f3-ea8755a255a8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:20.191090 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a342ad41-4d6a-432a-b4f3-ea8755a255a8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:20.520414 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-a342ad41-4d6a-432a-b4f3-ea8755a255a8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:20.541707 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-a342ad41-4d6a-432a-b4f3-ea8755a255a8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1520 microversion: 2.1 time: 0.368830 Sep 01 14:07:20.542854 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 77/160] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:20 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1520 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:21.567546 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-776518dc-b9aa-40b5-8dd7-9ed6ed38b49a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:21.574150 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-776518dc-b9aa-40b5-8dd7-9ed6ed38b49a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:21.579606 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-776518dc-b9aa-40b5-8dd7-9ed6ed38b49a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:21.581406 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-776518dc-b9aa-40b5-8dd7-9ed6ed38b49a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:21.581739 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-776518dc-b9aa-40b5-8dd7-9ed6ed38b49a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:21.582943 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-776518dc-b9aa-40b5-8dd7-9ed6ed38b49a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:21.583781 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-776518dc-b9aa-40b5-8dd7-9ed6ed38b49a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:21.584514 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-776518dc-b9aa-40b5-8dd7-9ed6ed38b49a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:21.848991 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-776518dc-b9aa-40b5-8dd7-9ed6ed38b49a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:21.859478 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-776518dc-b9aa-40b5-8dd7-9ed6ed38b49a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1520 microversion: 2.1 time: 0.298336 Sep 01 14:07:21.863967 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 84/161] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:21 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1520 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:22.884622 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-96d44aa4-e208-495e-8207-1c51de3766ad tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:22.885551 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-96d44aa4-e208-495e-8207-1c51de3766ad tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:22.892001 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-96d44aa4-e208-495e-8207-1c51de3766ad tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:22.893190 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-96d44aa4-e208-495e-8207-1c51de3766ad tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:22.894968 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-96d44aa4-e208-495e-8207-1c51de3766ad tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:22.895736 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-96d44aa4-e208-495e-8207-1c51de3766ad tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:22.896871 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-96d44aa4-e208-495e-8207-1c51de3766ad tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:22.897553 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-96d44aa4-e208-495e-8207-1c51de3766ad tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:23.438071 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-96d44aa4-e208-495e-8207-1c51de3766ad tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:23.464371 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-96d44aa4-e208-495e-8207-1c51de3766ad tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1520 microversion: 2.1 time: 0.583362 Sep 01 14:07:23.466460 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 78/162] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:22 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1520 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:07:24.488857 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-f3d95aeb-4d1f-45b1-b372-73bc393b1312 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:24.490071 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-f3d95aeb-4d1f-45b1-b372-73bc393b1312 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:24.497261 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f3d95aeb-4d1f-45b1-b372-73bc393b1312 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:24.497759 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f3d95aeb-4d1f-45b1-b372-73bc393b1312 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:24.498521 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f3d95aeb-4d1f-45b1-b372-73bc393b1312 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:24.499674 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f3d95aeb-4d1f-45b1-b372-73bc393b1312 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:24.500143 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f3d95aeb-4d1f-45b1-b372-73bc393b1312 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:24.500572 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f3d95aeb-4d1f-45b1-b372-73bc393b1312 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:24.731828 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-f3d95aeb-4d1f-45b1-b372-73bc393b1312 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:24.744793 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-f3d95aeb-4d1f-45b1-b372-73bc393b1312 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1520 microversion: 2.1 time: 0.259975 Sep 01 14:07:24.746774 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 85/163] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:24 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1520 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:07:25.774342 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-bf69f527-fd07-4a40-835a-346893f9f459 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:25.780570 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-bf69f527-fd07-4a40-835a-346893f9f459 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:25.794012 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-bf69f527-fd07-4a40-835a-346893f9f459 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:25.794989 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-bf69f527-fd07-4a40-835a-346893f9f459 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:25.795622 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-bf69f527-fd07-4a40-835a-346893f9f459 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:25.796742 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-bf69f527-fd07-4a40-835a-346893f9f459 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:25.797780 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-bf69f527-fd07-4a40-835a-346893f9f459 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:25.798465 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-bf69f527-fd07-4a40-835a-346893f9f459 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:26.035565 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-bf69f527-fd07-4a40-835a-346893f9f459 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:26.052055 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-bf69f527-fd07-4a40-835a-346893f9f459 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1520 microversion: 2.1 time: 0.287513 Sep 01 14:07:26.053390 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 79/164] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:25 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1520 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:27.088385 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-b06040e4-1c78-43b2-ac1f-96662754159e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:27.089288 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-b06040e4-1c78-43b2-ac1f-96662754159e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:27.092132 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:27.105195 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b06040e4-1c78-43b2-ac1f-96662754159e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:27.106584 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b06040e4-1c78-43b2-ac1f-96662754159e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:27.107048 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b06040e4-1c78-43b2-ac1f-96662754159e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:27.107967 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b06040e4-1c78-43b2-ac1f-96662754159e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:27.108419 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b06040e4-1c78-43b2-ac1f-96662754159e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:27.110177 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b06040e4-1c78-43b2-ac1f-96662754159e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:27.396310 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-b06040e4-1c78-43b2-ac1f-96662754159e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:27.423483 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-b06040e4-1c78-43b2-ac1f-96662754159e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1520 microversion: 2.1 time: 0.336294 Sep 01 14:07:27.426069 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 86/165] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:27 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1520 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:27.768091 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-ab3f0883-66e4-46a4-9383-4439a56cdb76 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-817903003", "imageRef": "9be77128-e763-4225-b76f-85fbb04ad9b2", "flavorRef": "452"}} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:07:27.834933 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.network.neutron [None req-ab3f0883-66e4-46a4-9383-4439a56cdb76 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] validate_networks() for None {{(pid=121339) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:07:28.358182 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.virt.hardware [None req-ab3f0883-66e4-46a4-9383-4439a56cdb76 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Flavor limits 0:0:0 {{(pid=121339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:07:28.359262 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.virt.hardware [None req-ab3f0883-66e4-46a4-9383-4439a56cdb76 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Image limits 0:0:0 {{(pid=121339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:07:28.360107 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.virt.hardware [None req-ab3f0883-66e4-46a4-9383-4439a56cdb76 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Flavor pref 0:0:0 {{(pid=121339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:07:28.361097 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.virt.hardware [None req-ab3f0883-66e4-46a4-9383-4439a56cdb76 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Image pref 0:0:0 {{(pid=121339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:07:28.363296 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.virt.hardware [None req-ab3f0883-66e4-46a4-9383-4439a56cdb76 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:07:28.375663 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ab3f0883-66e4-46a4-9383-4439a56cdb76 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:28.376615 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ab3f0883-66e4-46a4-9383-4439a56cdb76 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:28.378248 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ab3f0883-66e4-46a4-9383-4439a56cdb76 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:28.380166 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ab3f0883-66e4-46a4-9383-4439a56cdb76 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:28.381189 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ab3f0883-66e4-46a4-9383-4439a56cdb76 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:28.382368 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ab3f0883-66e4-46a4-9383-4439a56cdb76 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:28.420037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.quota [None req-ab3f0883-66e4-46a4-9383-4439a56cdb76 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Getting quotas for project 1c13f664f15145fdb9b3c4b9f8496d80. Resources: {'cores', 'instances', 'ram'} {{(pid=121339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:07:28.429946 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.quota [None req-ab3f0883-66e4-46a4-9383-4439a56cdb76 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Getting quotas for user 446af6bea953401ead7e8a9c9604d8d0 and project 1c13f664f15145fdb9b3c4b9f8496d80. Resources: {'cores', 'instances', 'ram'} {{(pid=121339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:07:28.456994 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-e9f36331-463a-4a2b-b944-bbeec7ed5ccc tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:28.457886 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-ab3f0883-66e4-46a4-9383-4439a56cdb76 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Going to run 1 instances... {{(pid=121339) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:07:28.459510 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-e9f36331-463a-4a2b-b944-bbeec7ed5ccc tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:28.465045 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-ab3f0883-66e4-46a4-9383-4439a56cdb76 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] [instance: 7e0f8565-bc64-439c-be78-3385624198b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9be77128-e763-4225-b76f-85fbb04ad9b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:07:28.472276 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e9f36331-463a-4a2b-b944-bbeec7ed5ccc tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:28.473350 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e9f36331-463a-4a2b-b944-bbeec7ed5ccc tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:28.474523 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e9f36331-463a-4a2b-b944-bbeec7ed5ccc tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:28.476282 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e9f36331-463a-4a2b-b944-bbeec7ed5ccc tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:28.477481 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e9f36331-463a-4a2b-b944-bbeec7ed5ccc tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:28.478756 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e9f36331-463a-4a2b-b944-bbeec7ed5ccc tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:28.708628 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-ab3f0883-66e4-46a4-9383-4439a56cdb76 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.944690 Sep 01 14:07:28.710759 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 80/166] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 1 14:07:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 14:07:28.730860 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-39fb7e8f-f17e-4a4d-8fb8-1df641844bd1 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:28.732335 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-39fb7e8f-f17e-4a4d-8fb8-1df641844bd1 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] [instance: 7e0f8565-bc64-439c-be78-3385624198b5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:28.808675 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-e9f36331-463a-4a2b-b944-bbeec7ed5ccc tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:28.829076 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-e9f36331-463a-4a2b-b944-bbeec7ed5ccc tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1520 microversion: 2.1 time: 0.380687 Sep 01 14:07:28.846368 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 87/167] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:28 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1520 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:28.851383 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-39fb7e8f-f17e-4a4d-8fb8-1df641844bd1 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446af6bea953401ead7e8a9c9604d8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c13f664f15145fdb9b3c4b9f8496d80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:28.868006 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-39fb7e8f-f17e-4a4d-8fb8-1df641844bd1 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5" status: 200 len: 1214 microversion: 2.1 time: 0.144585 Sep 01 14:07:28.868835 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 81/168] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:28 2022] GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5 => generated 1214 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:29.866588 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-884b86ae-bacc-4089-ae26-021193ba0d27 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:29.867982 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-884b86ae-bacc-4089-ae26-021193ba0d27 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:29.874960 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-884b86ae-bacc-4089-ae26-021193ba0d27 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:29.875591 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-884b86ae-bacc-4089-ae26-021193ba0d27 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:29.876211 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-884b86ae-bacc-4089-ae26-021193ba0d27 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:29.877815 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-884b86ae-bacc-4089-ae26-021193ba0d27 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:29.878495 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-884b86ae-bacc-4089-ae26-021193ba0d27 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:29.878907 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-884b86ae-bacc-4089-ae26-021193ba0d27 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:29.905779 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-6a67ad40-fe10-4ed2-a450-479bc7eded35 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:29.907260 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-6a67ad40-fe10-4ed2-a450-479bc7eded35 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] [instance: 7e0f8565-bc64-439c-be78-3385624198b5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:30.053646 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-6a67ad40-fe10-4ed2-a450-479bc7eded35 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446af6bea953401ead7e8a9c9604d8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c13f664f15145fdb9b3c4b9f8496d80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:30.064260 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-6a67ad40-fe10-4ed2-a450-479bc7eded35 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5" status: 200 len: 1214 microversion: 2.1 time: 0.177234 Sep 01 14:07:30.065021 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 82/169] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:29 2022] GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5 => generated 1214 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:30.195987 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-884b86ae-bacc-4089-ae26-021193ba0d27 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:30.214428 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-884b86ae-bacc-4089-ae26-021193ba0d27 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1520 microversion: 2.1 time: 0.352173 Sep 01 14:07:30.215976 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 88/170] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:29 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1520 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:30.352957 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-484c0564-a365-4d15-b9a1-7bdc3f14a672 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Action: 'create', calling method: .version_select at 0x7f9867c39e50>, body: {"keypair": {"name": "tempest-keypair-1950389809", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOrPEYB0mfQkE14alzH1aFQJOBYD0OlfAFh1bEtnrSOtrcNx7G+P5F1RlbZ+wSm4HJoKgWAYU6Z7y4jfze8FgZZEx8VmtSPO3VOxfHr6U6tY1HQOw9XJhfbxYxtEi0Jhw=="}} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:07:30.379017 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.quota [None req-484c0564-a365-4d15-b9a1-7bdc3f14a672 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Getting quotas for project 90a84500a899479aabfa3aeb72b4c4ae. Resources: {'key_pairs'} {{(pid=121339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:07:30.390679 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.quota [None req-484c0564-a365-4d15-b9a1-7bdc3f14a672 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Getting quotas for user 7ae66df61a764a42a1b1b15f54d5c34b and project 90a84500a899479aabfa3aeb72b4c4ae. Resources: {'key_pairs'} {{(pid=121339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:07:30.588215 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-484c0564-a365-4d15-b9a1-7bdc3f14a672 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.513934 Sep 01 14:07:30.591143 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 83/171] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Sep 1 14:07:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:07:31.103212 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-d1954586-e3dd-4ae2-949c-1e3c84d66a08 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:31.104319 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-d1954586-e3dd-4ae2-949c-1e3c84d66a08 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] [instance: 7e0f8565-bc64-439c-be78-3385624198b5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:31.114311 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d1954586-e3dd-4ae2-949c-1e3c84d66a08 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:31.115235 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d1954586-e3dd-4ae2-949c-1e3c84d66a08 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:31.115867 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d1954586-e3dd-4ae2-949c-1e3c84d66a08 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:31.117243 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d1954586-e3dd-4ae2-949c-1e3c84d66a08 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:31.117844 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d1954586-e3dd-4ae2-949c-1e3c84d66a08 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:31.118526 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d1954586-e3dd-4ae2-949c-1e3c84d66a08 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:31.228907 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-d1954586-e3dd-4ae2-949c-1e3c84d66a08 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446af6bea953401ead7e8a9c9604d8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c13f664f15145fdb9b3c4b9f8496d80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:31.241272 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-1265c855-5e8a-49e3-b97b-f7f25f10076f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:31.243104 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-1265c855-5e8a-49e3-b97b-f7f25f10076f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:31.245221 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-d1954586-e3dd-4ae2-949c-1e3c84d66a08 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5" status: 200 len: 1218 microversion: 2.1 time: 0.149769 Sep 01 14:07:31.246326 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 89/172] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:31 2022] GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5 => generated 1218 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:31.255362 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1265c855-5e8a-49e3-b97b-f7f25f10076f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:31.255362 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1265c855-5e8a-49e3-b97b-f7f25f10076f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:31.255362 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1265c855-5e8a-49e3-b97b-f7f25f10076f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:31.256159 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1265c855-5e8a-49e3-b97b-f7f25f10076f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:31.256769 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1265c855-5e8a-49e3-b97b-f7f25f10076f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:31.257401 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1265c855-5e8a-49e3-b97b-f7f25f10076f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:31.261267 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell1:SELECT=96 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:31.581798 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-1265c855-5e8a-49e3-b97b-f7f25f10076f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:31.605964 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-1265c855-5e8a-49e3-b97b-f7f25f10076f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1520 microversion: 2.1 time: 0.369713 Sep 01 14:07:31.607325 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 84/173] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:31 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1520 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:32.284475 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-506b5664-20e4-4329-9cfb-18b141c0df21 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:32.289217 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-506b5664-20e4-4329-9cfb-18b141c0df21 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] [instance: 7e0f8565-bc64-439c-be78-3385624198b5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:32.306408 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-506b5664-20e4-4329-9cfb-18b141c0df21 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:32.306974 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-506b5664-20e4-4329-9cfb-18b141c0df21 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:32.307571 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-506b5664-20e4-4329-9cfb-18b141c0df21 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:32.320674 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-506b5664-20e4-4329-9cfb-18b141c0df21 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:32.320674 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-506b5664-20e4-4329-9cfb-18b141c0df21 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:32.320674 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-506b5664-20e4-4329-9cfb-18b141c0df21 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:32.445525 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-506b5664-20e4-4329-9cfb-18b141c0df21 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446af6bea953401ead7e8a9c9604d8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c13f664f15145fdb9b3c4b9f8496d80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:32.462824 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-506b5664-20e4-4329-9cfb-18b141c0df21 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5" status: 200 len: 1210 microversion: 2.1 time: 0.191535 Sep 01 14:07:32.464225 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 90/174] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:32 2022] GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5 => generated 1210 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:32.647012 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-da05d5ae-2798-4ef4-a968-d59a0364dc2d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:32.647815 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-da05d5ae-2798-4ef4-a968-d59a0364dc2d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:32.651155 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:32.660082 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-da05d5ae-2798-4ef4-a968-d59a0364dc2d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:32.664711 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-da05d5ae-2798-4ef4-a968-d59a0364dc2d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:32.664711 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-da05d5ae-2798-4ef4-a968-d59a0364dc2d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:32.664711 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-da05d5ae-2798-4ef4-a968-d59a0364dc2d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:32.665776 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-da05d5ae-2798-4ef4-a968-d59a0364dc2d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:32.666701 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-da05d5ae-2798-4ef4-a968-d59a0364dc2d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:33.094959 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-da05d5ae-2798-4ef4-a968-d59a0364dc2d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:33.107215 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-da05d5ae-2798-4ef4-a968-d59a0364dc2d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1520 microversion: 2.1 time: 0.468350 Sep 01 14:07:33.107821 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 85/175] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:32 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1520 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:07:33.496793 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-80ac234a-3e28-4a33-945e-a787ce51e81a tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:33.497938 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-80ac234a-3e28-4a33-945e-a787ce51e81a tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] [instance: 7e0f8565-bc64-439c-be78-3385624198b5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:33.509787 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-80ac234a-3e28-4a33-945e-a787ce51e81a tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:33.510684 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-80ac234a-3e28-4a33-945e-a787ce51e81a tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:33.511567 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-80ac234a-3e28-4a33-945e-a787ce51e81a tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:33.512866 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-80ac234a-3e28-4a33-945e-a787ce51e81a tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:33.513702 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-80ac234a-3e28-4a33-945e-a787ce51e81a tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:33.514534 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-80ac234a-3e28-4a33-945e-a787ce51e81a tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:33.681648 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-80ac234a-3e28-4a33-945e-a787ce51e81a tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446af6bea953401ead7e8a9c9604d8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c13f664f15145fdb9b3c4b9f8496d80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:33.691435 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-80ac234a-3e28-4a33-945e-a787ce51e81a tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5" status: 200 len: 1266 microversion: 2.1 time: 0.202023 Sep 01 14:07:33.692353 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 91/176] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:33 2022] GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5 => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:34.141675 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-ff629fc1-6ac4-4f4c-826d-054873de6735 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:34.143720 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-ff629fc1-6ac4-4f4c-826d-054873de6735 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:34.150959 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ff629fc1-6ac4-4f4c-826d-054873de6735 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:34.151781 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ff629fc1-6ac4-4f4c-826d-054873de6735 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:34.152220 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ff629fc1-6ac4-4f4c-826d-054873de6735 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:34.153079 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ff629fc1-6ac4-4f4c-826d-054873de6735 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:34.153568 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ff629fc1-6ac4-4f4c-826d-054873de6735 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:34.154017 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ff629fc1-6ac4-4f4c-826d-054873de6735 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:34.590655 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-ff629fc1-6ac4-4f4c-826d-054873de6735 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:34.609808 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-ff629fc1-6ac4-4f4c-826d-054873de6735 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1520 microversion: 2.1 time: 0.472723 Sep 01 14:07:34.627277 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 86/177] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:34 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1520 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:34.725677 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-33625966-cf15-4551-9ee6-072222a46ef4 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:34.728044 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-33625966-cf15-4551-9ee6-072222a46ef4 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] [instance: 7e0f8565-bc64-439c-be78-3385624198b5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:34.753852 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-33625966-cf15-4551-9ee6-072222a46ef4 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:34.759046 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-33625966-cf15-4551-9ee6-072222a46ef4 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:34.761766 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-33625966-cf15-4551-9ee6-072222a46ef4 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:34.763646 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-33625966-cf15-4551-9ee6-072222a46ef4 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:34.764439 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-33625966-cf15-4551-9ee6-072222a46ef4 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:34.765205 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-33625966-cf15-4551-9ee6-072222a46ef4 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:34.773749 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell1:SELECT=100 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:35.077527 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-33625966-cf15-4551-9ee6-072222a46ef4 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446af6bea953401ead7e8a9c9604d8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c13f664f15145fdb9b3c4b9f8496d80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:35.128341 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-33625966-cf15-4551-9ee6-072222a46ef4 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5" status: 200 len: 1266 microversion: 2.1 time: 0.407429 Sep 01 14:07:35.128969 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 92/178] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:34 2022] GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5 => generated 1266 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:35.505650 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-2b214b79-6030-4fb6-8405-731df4d04dc4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1192656623", "imageRef": "9be77128-e763-4225-b76f-85fbb04ad9b2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4f2459fa-f112-4ee1-abd3-6f4952507858"}], "security_groups": [{"name": "tempest-securitygroup--1301829720"}], "key_name": "tempest-keypair-1950389809", "user_data": "}} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:07:35.635133 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-0016125b-a617-4e84-b637-6331545b6373 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:35.635790 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-0016125b-a617-4e84-b637-6331545b6373 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:35.644668 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0016125b-a617-4e84-b637-6331545b6373 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:35.645877 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0016125b-a617-4e84-b637-6331545b6373 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:35.646722 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0016125b-a617-4e84-b637-6331545b6373 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:35.648025 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0016125b-a617-4e84-b637-6331545b6373 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:35.648912 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0016125b-a617-4e84-b637-6331545b6373 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:35.649660 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0016125b-a617-4e84-b637-6331545b6373 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:35.690125 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.network.neutron [None req-2b214b79-6030-4fb6-8405-731df4d04dc4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] validate_networks() for [('4f2459fa-f112-4ee1-abd3-6f4952507858', None, None, None, None, None)] {{(pid=121339) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:07:35.965136 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-0016125b-a617-4e84-b637-6331545b6373 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:35.986064 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-0016125b-a617-4e84-b637-6331545b6373 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1500 microversion: 2.1 time: 0.355785 Sep 01 14:07:35.995364 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 93/179] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:35 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1500 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:36.025332 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-d9b66f70-b1ca-414d-a522-926d7e6cc78e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:36.026116 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-d9b66f70-b1ca-414d-a522-926d7e6cc78e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 846e670d-c808-44d5-be0e-9c36671fbe91] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:36.032764 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d9b66f70-b1ca-414d-a522-926d7e6cc78e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:36.033430 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d9b66f70-b1ca-414d-a522-926d7e6cc78e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:36.034191 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d9b66f70-b1ca-414d-a522-926d7e6cc78e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:36.035033 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d9b66f70-b1ca-414d-a522-926d7e6cc78e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:36.035553 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d9b66f70-b1ca-414d-a522-926d7e6cc78e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:36.036099 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d9b66f70-b1ca-414d-a522-926d7e6cc78e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:36.538765 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-d9b66f70-b1ca-414d-a522-926d7e6cc78e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:36.561108 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-d9b66f70-b1ca-414d-a522-926d7e6cc78e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91" status: 200 len: 1516 microversion: 2.1 time: 0.542344 Sep 01 14:07:36.562193 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 94/180] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:36 2022] GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91 => generated 1516 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:07:36.584869 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-aed8d916-222a-40f2-8376-e8b560899975 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:36.586424 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-aed8d916-222a-40f2-8376-e8b560899975 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] [instance: 7e0f8565-bc64-439c-be78-3385624198b5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:36.599479 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-aed8d916-222a-40f2-8376-e8b560899975 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:36.600353 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-aed8d916-222a-40f2-8376-e8b560899975 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:36.601134 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-aed8d916-222a-40f2-8376-e8b560899975 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:36.603272 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-aed8d916-222a-40f2-8376-e8b560899975 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:36.604209 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-aed8d916-222a-40f2-8376-e8b560899975 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:36.604877 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-aed8d916-222a-40f2-8376-e8b560899975 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:36.794174 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-aed8d916-222a-40f2-8376-e8b560899975 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446af6bea953401ead7e8a9c9604d8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c13f664f15145fdb9b3c4b9f8496d80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:36.806836 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-aed8d916-222a-40f2-8376-e8b560899975 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5" status: 200 len: 1272 microversion: 2.1 time: 0.236690 Sep 01 14:07:36.808897 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 95/181] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:36 2022] GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5 => generated 1272 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:36.841508 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.virt.hardware [None req-2b214b79-6030-4fb6-8405-731df4d04dc4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Flavor limits 0:0:0 {{(pid=121339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:07:36.842395 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.virt.hardware [None req-2b214b79-6030-4fb6-8405-731df4d04dc4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Image limits 0:0:0 {{(pid=121339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:07:36.843480 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.virt.hardware [None req-2b214b79-6030-4fb6-8405-731df4d04dc4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Flavor pref 0:0:0 {{(pid=121339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:07:36.844509 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.virt.hardware [None req-2b214b79-6030-4fb6-8405-731df4d04dc4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Image pref 0:0:0 {{(pid=121339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:07:36.845588 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.virt.hardware [None req-2b214b79-6030-4fb6-8405-731df4d04dc4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:07:36.863225 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2b214b79-6030-4fb6-8405-731df4d04dc4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:36.864205 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2b214b79-6030-4fb6-8405-731df4d04dc4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:36.865136 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2b214b79-6030-4fb6-8405-731df4d04dc4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:36.867246 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2b214b79-6030-4fb6-8405-731df4d04dc4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:36.868189 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2b214b79-6030-4fb6-8405-731df4d04dc4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:36.869077 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2b214b79-6030-4fb6-8405-731df4d04dc4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:36.909821 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.quota [None req-2b214b79-6030-4fb6-8405-731df4d04dc4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Getting quotas for project 90a84500a899479aabfa3aeb72b4c4ae. Resources: {'cores', 'instances', 'ram'} {{(pid=121339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:07:36.918907 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.quota [None req-2b214b79-6030-4fb6-8405-731df4d04dc4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Getting quotas for user 7ae66df61a764a42a1b1b15f54d5c34b and project 90a84500a899479aabfa3aeb72b4c4ae. Resources: {'cores', 'instances', 'ram'} {{(pid=121339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:07:36.944102 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-2b214b79-6030-4fb6-8405-731df4d04dc4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Going to run 1 instances... {{(pid=121339) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:07:36.954188 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-2b214b79-6030-4fb6-8405-731df4d04dc4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 91814986-adf4-46cb-8edf-820106d37ecb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9be77128-e763-4225-b76f-85fbb04ad9b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:07:37.191530 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-2b214b79-6030-4fb6-8405-731df4d04dc4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.690612 Sep 01 14:07:37.195266 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 87/182] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 1 14:07:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 1695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 14:07:37.212655 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-bbc2af30-bfe3-4345-b62e-3c20aedaab61 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:37.214833 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-bbc2af30-bfe3-4345-b62e-3c20aedaab61 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 91814986-adf4-46cb-8edf-820106d37ecb] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:37.317491 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-bbc2af30-bfe3-4345-b62e-3c20aedaab61 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:37.328808 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-bbc2af30-bfe3-4345-b62e-3c20aedaab61 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb" status: 200 len: 1242 microversion: 2.1 time: 0.123044 Sep 01 14:07:37.330155 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 96/183] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:37 2022] GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb => generated 1242 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:37.849489 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-5b8cafb2-f362-4b0c-8fe2-33ff41dfaa32 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:37.850646 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-5b8cafb2-f362-4b0c-8fe2-33ff41dfaa32 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] [instance: 7e0f8565-bc64-439c-be78-3385624198b5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:37.859655 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5b8cafb2-f362-4b0c-8fe2-33ff41dfaa32 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:37.860483 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5b8cafb2-f362-4b0c-8fe2-33ff41dfaa32 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:37.861198 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5b8cafb2-f362-4b0c-8fe2-33ff41dfaa32 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:37.862462 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5b8cafb2-f362-4b0c-8fe2-33ff41dfaa32 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:37.863319 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5b8cafb2-f362-4b0c-8fe2-33ff41dfaa32 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:37.864061 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5b8cafb2-f362-4b0c-8fe2-33ff41dfaa32 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:38.068750 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-5b8cafb2-f362-4b0c-8fe2-33ff41dfaa32 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446af6bea953401ead7e8a9c9604d8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c13f664f15145fdb9b3c4b9f8496d80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:38.086270 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-5b8cafb2-f362-4b0c-8fe2-33ff41dfaa32 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5" status: 200 len: 1314 microversion: 2.1 time: 0.242759 Sep 01 14:07:38.089568 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 88/184] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:37 2022] GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:38.365203 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-6a90e23f-30d9-49eb-b5a9-681d82404f48 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:38.365859 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-6a90e23f-30d9-49eb-b5a9-681d82404f48 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 91814986-adf4-46cb-8edf-820106d37ecb] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:38.467449 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-6a90e23f-30d9-49eb-b5a9-681d82404f48 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:38.482817 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-6a90e23f-30d9-49eb-b5a9-681d82404f48 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb" status: 200 len: 1242 microversion: 2.1 time: 0.122036 Sep 01 14:07:38.483628 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 97/185] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:38 2022] GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb => generated 1242 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:39.118271 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-6fd64419-3f01-4687-bb97-c9c05bd1e238 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:39.119345 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-6fd64419-3f01-4687-bb97-c9c05bd1e238 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] [instance: 7e0f8565-bc64-439c-be78-3385624198b5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:39.131417 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6fd64419-3f01-4687-bb97-c9c05bd1e238 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:39.132305 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6fd64419-3f01-4687-bb97-c9c05bd1e238 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:39.133109 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6fd64419-3f01-4687-bb97-c9c05bd1e238 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:39.134770 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6fd64419-3f01-4687-bb97-c9c05bd1e238 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:39.135611 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6fd64419-3f01-4687-bb97-c9c05bd1e238 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:39.136668 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6fd64419-3f01-4687-bb97-c9c05bd1e238 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:39.351641 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-6fd64419-3f01-4687-bb97-c9c05bd1e238 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446af6bea953401ead7e8a9c9604d8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c13f664f15145fdb9b3c4b9f8496d80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:39.386683 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-6fd64419-3f01-4687-bb97-c9c05bd1e238 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5" status: 200 len: 1314 microversion: 2.1 time: 0.275903 Sep 01 14:07:39.388213 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 89/186] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:39 2022] GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:39.507543 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-9fbad2f7-c929-4da4-b567-86834a2662f9 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:39.519304 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-9fbad2f7-c929-4da4-b567-86834a2662f9 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 91814986-adf4-46cb-8edf-820106d37ecb] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:39.519304 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9fbad2f7-c929-4da4-b567-86834a2662f9 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:39.519304 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9fbad2f7-c929-4da4-b567-86834a2662f9 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:39.519304 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9fbad2f7-c929-4da4-b567-86834a2662f9 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:39.520185 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9fbad2f7-c929-4da4-b567-86834a2662f9 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:39.520365 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9fbad2f7-c929-4da4-b567-86834a2662f9 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:39.520669 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9fbad2f7-c929-4da4-b567-86834a2662f9 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:39.616204 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-9fbad2f7-c929-4da4-b567-86834a2662f9 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:39.625865 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-9fbad2f7-c929-4da4-b567-86834a2662f9 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb" status: 200 len: 1246 microversion: 2.1 time: 0.122636 Sep 01 14:07:39.626473 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 98/187] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:39 2022] GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb => generated 1246 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:39.776286 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-b641b978-5625-4716-8292-3df395e8984c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:07:39.779988 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-b641b978-5625-4716-8292-3df395e8984c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 846e670d-c808-44d5-be0e-9c36671fbe91] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:39.789872 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b641b978-5625-4716-8292-3df395e8984c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:39.790635 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b641b978-5625-4716-8292-3df395e8984c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:39.791246 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b641b978-5625-4716-8292-3df395e8984c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:39.792360 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b641b978-5625-4716-8292-3df395e8984c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:39.793286 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b641b978-5625-4716-8292-3df395e8984c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:39.794159 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b641b978-5625-4716-8292-3df395e8984c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:39.855623 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.objects.instance [None req-b641b978-5625-4716-8292-3df395e8984c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lazy-loading 'flavor' on Instance uuid 846e670d-c808-44d5-be0e-9c36671fbe91 {{(pid=121339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:07:40.316920 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [req-3b9ed212-a8a1-4350-91cf-fe33dccc55a6 req-00b0e83a-e2b4-4335-a394-e9ea7f9594be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e0f8565-bc64-439c-be78-3385624198b5", "tag": "567f782a-6b5e-4df4-9763-c0f2c4ed650f"}]} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:07:40.328182 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-3b9ed212-a8a1-4350-91cf-fe33dccc55a6 req-00b0e83a-e2b4-4335-a394-e9ea7f9594be service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:40.328820 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-3b9ed212-a8a1-4350-91cf-fe33dccc55a6 req-00b0e83a-e2b4-4335-a394-e9ea7f9594be service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:40.330206 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-3b9ed212-a8a1-4350-91cf-fe33dccc55a6 req-00b0e83a-e2b4-4335-a394-e9ea7f9594be service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:40.344872 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-b641b978-5625-4716-8292-3df395e8984c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "POST /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91/action" status: 200 len: 32 microversion: 2.1 time: 0.579746 Sep 01 14:07:40.347675 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 90/188] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Sep 1 14:07:39 2022] POST /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91/action => generated 32 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 01 14:07:40.360321 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.compute.server_external_events [req-3b9ed212-a8a1-4350-91cf-fe33dccc55a6 req-00b0e83a-e2b4-4335-a394-e9ea7f9594be service nova] Creating event network-changed:567f782a-6b5e-4df4-9763-c0f2c4ed650f for instance 7e0f8565-bc64-439c-be78-3385624198b5 on hv-cinder-85221 Sep 01 14:07:40.367627 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [req-3b9ed212-a8a1-4350-91cf-fe33dccc55a6 req-00b0e83a-e2b4-4335-a394-e9ea7f9594be service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054365 Sep 01 14:07:40.368983 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 99/189] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:07:40.370578 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-d4a756b2-0a3f-40b3-97c7-570cb5bb1ec1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:40.372063 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-d4a756b2-0a3f-40b3-97c7-570cb5bb1ec1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 846e670d-c808-44d5-be0e-9c36671fbe91] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:40.384955 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d4a756b2-0a3f-40b3-97c7-570cb5bb1ec1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:40.384955 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d4a756b2-0a3f-40b3-97c7-570cb5bb1ec1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:40.384955 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d4a756b2-0a3f-40b3-97c7-570cb5bb1ec1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:40.384955 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d4a756b2-0a3f-40b3-97c7-570cb5bb1ec1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:40.385297 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d4a756b2-0a3f-40b3-97c7-570cb5bb1ec1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:40.385297 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d4a756b2-0a3f-40b3-97c7-570cb5bb1ec1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:40.425155 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-700e9367-1630-4943-9d84-0d9a66709474 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:40.425875 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-700e9367-1630-4943-9d84-0d9a66709474 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] [instance: 7e0f8565-bc64-439c-be78-3385624198b5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:40.441746 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-700e9367-1630-4943-9d84-0d9a66709474 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:40.442518 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-700e9367-1630-4943-9d84-0d9a66709474 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:40.443113 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-700e9367-1630-4943-9d84-0d9a66709474 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:40.444192 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-700e9367-1630-4943-9d84-0d9a66709474 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:40.445381 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-700e9367-1630-4943-9d84-0d9a66709474 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:40.446414 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-700e9367-1630-4943-9d84-0d9a66709474 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:40.640219 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-d4a756b2-0a3f-40b3-97c7-570cb5bb1ec1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:40.672785 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-d4a756b2-0a3f-40b3-97c7-570cb5bb1ec1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91" status: 200 len: 1522 microversion: 2.1 time: 0.317735 Sep 01 14:07:40.673747 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 91/190] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:40 2022] GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91 => generated 1522 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:40.683387 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-1ad030e3-f6ca-4a69-ae89-9f3bd6ac7c0c tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:40.684853 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-1ad030e3-f6ca-4a69-ae89-9f3bd6ac7c0c tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 91814986-adf4-46cb-8edf-820106d37ecb] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:40.700836 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1ad030e3-f6ca-4a69-ae89-9f3bd6ac7c0c tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:40.700836 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1ad030e3-f6ca-4a69-ae89-9f3bd6ac7c0c tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:40.700836 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1ad030e3-f6ca-4a69-ae89-9f3bd6ac7c0c tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:40.701972 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1ad030e3-f6ca-4a69-ae89-9f3bd6ac7c0c tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:40.703927 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1ad030e3-f6ca-4a69-ae89-9f3bd6ac7c0c tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:40.704694 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1ad030e3-f6ca-4a69-ae89-9f3bd6ac7c0c tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:40.708613 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-700e9367-1630-4943-9d84-0d9a66709474 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446af6bea953401ead7e8a9c9604d8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c13f664f15145fdb9b3c4b9f8496d80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:40.734316 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-700e9367-1630-4943-9d84-0d9a66709474 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5" status: 200 len: 1314 microversion: 2.1 time: 0.315001 Sep 01 14:07:40.735196 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 100/191] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:40 2022] GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5 => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:07:40.794294 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-1ad030e3-f6ca-4a69-ae89-9f3bd6ac7c0c tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:40.809362 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-1ad030e3-f6ca-4a69-ae89-9f3bd6ac7c0c tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb" status: 200 len: 1294 microversion: 2.1 time: 0.132897 Sep 01 14:07:40.810100 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 92/192] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:40 2022] GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb => generated 1294 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:41.710957 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-212241b8-4122-43c9-b8b5-a3910226d554 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:41.729514 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-212241b8-4122-43c9-b8b5-a3910226d554 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 846e670d-c808-44d5-be0e-9c36671fbe91] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:41.729514 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-212241b8-4122-43c9-b8b5-a3910226d554 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:41.729514 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-212241b8-4122-43c9-b8b5-a3910226d554 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:41.729514 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-212241b8-4122-43c9-b8b5-a3910226d554 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:41.730464 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-212241b8-4122-43c9-b8b5-a3910226d554 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:41.734475 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-212241b8-4122-43c9-b8b5-a3910226d554 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:41.734994 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-212241b8-4122-43c9-b8b5-a3910226d554 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:41.766862 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-15826e84-5be2-4e20-9dcf-92d4c8a99a36 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:41.767472 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-15826e84-5be2-4e20-9dcf-92d4c8a99a36 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] [instance: 7e0f8565-bc64-439c-be78-3385624198b5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:41.781718 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-15826e84-5be2-4e20-9dcf-92d4c8a99a36 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:41.782252 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-15826e84-5be2-4e20-9dcf-92d4c8a99a36 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:41.782687 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-15826e84-5be2-4e20-9dcf-92d4c8a99a36 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:41.783958 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-15826e84-5be2-4e20-9dcf-92d4c8a99a36 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:41.784725 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-15826e84-5be2-4e20-9dcf-92d4c8a99a36 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:41.785258 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-15826e84-5be2-4e20-9dcf-92d4c8a99a36 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:42.306136 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-212241b8-4122-43c9-b8b5-a3910226d554 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:42.313796 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-15826e84-5be2-4e20-9dcf-92d4c8a99a36 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446af6bea953401ead7e8a9c9604d8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c13f664f15145fdb9b3c4b9f8496d80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:42.323584 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-212241b8-4122-43c9-b8b5-a3910226d554 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91" status: 200 len: 1522 microversion: 2.1 time: 0.616867 Sep 01 14:07:42.325518 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 101/193] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:41 2022] GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91 => generated 1522 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:07:42.333731 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-15826e84-5be2-4e20-9dcf-92d4c8a99a36 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5" status: 200 len: 1314 microversion: 2.1 time: 0.570390 Sep 01 14:07:42.336380 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 93/194] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:41 2022] GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5 => generated 1314 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:07:42.354112 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-4f2a1652-1b13-4c9b-bf2e-de36a4e945e0 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:42.356346 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-4f2a1652-1b13-4c9b-bf2e-de36a4e945e0 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 91814986-adf4-46cb-8edf-820106d37ecb] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:42.366508 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4f2a1652-1b13-4c9b-bf2e-de36a4e945e0 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:42.367213 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4f2a1652-1b13-4c9b-bf2e-de36a4e945e0 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:42.367895 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4f2a1652-1b13-4c9b-bf2e-de36a4e945e0 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:42.370695 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4f2a1652-1b13-4c9b-bf2e-de36a4e945e0 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:42.371808 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4f2a1652-1b13-4c9b-bf2e-de36a4e945e0 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:42.374245 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4f2a1652-1b13-4c9b-bf2e-de36a4e945e0 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:42.480600 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-4f2a1652-1b13-4c9b-bf2e-de36a4e945e0 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:42.499226 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-4f2a1652-1b13-4c9b-bf2e-de36a4e945e0 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb" status: 200 len: 1300 microversion: 2.1 time: 0.171143 Sep 01 14:07:42.499848 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 102/195] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:42 2022] GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb => generated 1300 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:43.355818 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-cb5087e3-9e5e-4745-863d-9f73b29aa99c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:43.356342 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-cb5087e3-9e5e-4745-863d-9f73b29aa99c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 846e670d-c808-44d5-be0e-9c36671fbe91] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:43.363686 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-cb5087e3-9e5e-4745-863d-9f73b29aa99c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:43.364202 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-cb5087e3-9e5e-4745-863d-9f73b29aa99c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:43.364453 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-b89ebe40-0659-44f3-af0c-6fa036f6ed49 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:43.365150 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-cb5087e3-9e5e-4745-863d-9f73b29aa99c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:43.365299 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-b89ebe40-0659-44f3-af0c-6fa036f6ed49 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] [instance: 7e0f8565-bc64-439c-be78-3385624198b5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:43.365440 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-cb5087e3-9e5e-4745-863d-9f73b29aa99c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:43.365742 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-cb5087e3-9e5e-4745-863d-9f73b29aa99c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:43.366192 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-cb5087e3-9e5e-4745-863d-9f73b29aa99c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:43.382085 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b89ebe40-0659-44f3-af0c-6fa036f6ed49 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:43.382760 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b89ebe40-0659-44f3-af0c-6fa036f6ed49 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:43.383335 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b89ebe40-0659-44f3-af0c-6fa036f6ed49 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:43.384222 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b89ebe40-0659-44f3-af0c-6fa036f6ed49 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:43.384798 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b89ebe40-0659-44f3-af0c-6fa036f6ed49 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:43.385226 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b89ebe40-0659-44f3-af0c-6fa036f6ed49 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:43.577841 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-cb5087e3-9e5e-4745-863d-9f73b29aa99c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:43.588890 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-cb5087e3-9e5e-4745-863d-9f73b29aa99c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91" status: 200 len: 1522 microversion: 2.1 time: 0.237413 Sep 01 14:07:43.589580 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 94/196] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:43 2022] GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:43.596653 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-b89ebe40-0659-44f3-af0c-6fa036f6ed49 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446af6bea953401ead7e8a9c9604d8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c13f664f15145fdb9b3c4b9f8496d80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:43.598796 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-68c51834-fa70-420b-bbc3-b4554e822a14 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:43.599991 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-68c51834-fa70-420b-bbc3-b4554e822a14 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 91814986-adf4-46cb-8edf-820106d37ecb] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:43.610434 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-b89ebe40-0659-44f3-af0c-6fa036f6ed49 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5" status: 200 len: 1314 microversion: 2.1 time: 0.251093 Sep 01 14:07:43.611333 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 103/197] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:43 2022] GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5 => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:43.612158 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-68c51834-fa70-420b-bbc3-b4554e822a14 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:43.613077 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-68c51834-fa70-420b-bbc3-b4554e822a14 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:43.613876 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-68c51834-fa70-420b-bbc3-b4554e822a14 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:43.620363 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-68c51834-fa70-420b-bbc3-b4554e822a14 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:43.620363 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-68c51834-fa70-420b-bbc3-b4554e822a14 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:43.620363 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-68c51834-fa70-420b-bbc3-b4554e822a14 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:43.769016 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-68c51834-fa70-420b-bbc3-b4554e822a14 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:43.777145 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-68c51834-fa70-420b-bbc3-b4554e822a14 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb" status: 200 len: 1368 microversion: 2.1 time: 0.186136 Sep 01 14:07:43.777848 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 95/198] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:43 2022] GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb => generated 1368 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:44.627700 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-649afaee-4718-465b-b862-1e60074f5806 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:44.628451 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-649afaee-4718-465b-b862-1e60074f5806 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 846e670d-c808-44d5-be0e-9c36671fbe91] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:44.635539 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-649afaee-4718-465b-b862-1e60074f5806 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:44.636087 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-649afaee-4718-465b-b862-1e60074f5806 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:44.636522 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-649afaee-4718-465b-b862-1e60074f5806 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:44.637240 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-649afaee-4718-465b-b862-1e60074f5806 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:44.637746 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-649afaee-4718-465b-b862-1e60074f5806 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:44.638141 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-649afaee-4718-465b-b862-1e60074f5806 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:44.640075 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-bb8ee291-6653-4a11-8f9c-ccfa34176a1b tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:44.640708 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-bb8ee291-6653-4a11-8f9c-ccfa34176a1b tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] [instance: 7e0f8565-bc64-439c-be78-3385624198b5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:44.648319 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-bb8ee291-6653-4a11-8f9c-ccfa34176a1b tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:44.648930 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-bb8ee291-6653-4a11-8f9c-ccfa34176a1b tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:44.649376 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-bb8ee291-6653-4a11-8f9c-ccfa34176a1b tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:44.650141 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-bb8ee291-6653-4a11-8f9c-ccfa34176a1b tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:44.652355 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-bb8ee291-6653-4a11-8f9c-ccfa34176a1b tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:44.652355 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-bb8ee291-6653-4a11-8f9c-ccfa34176a1b tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:44.914963 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-bb8ee291-6653-4a11-8f9c-ccfa34176a1b tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446af6bea953401ead7e8a9c9604d8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c13f664f15145fdb9b3c4b9f8496d80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:44.915944 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-649afaee-4718-465b-b862-1e60074f5806 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:44.925231 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-649afaee-4718-465b-b862-1e60074f5806 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91" status: 200 len: 1522 microversion: 2.1 time: 0.301834 Sep 01 14:07:44.925821 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 104/199] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:44 2022] GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91 => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:07:44.930127 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-bb8ee291-6653-4a11-8f9c-ccfa34176a1b tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5" status: 200 len: 1314 microversion: 2.1 time: 0.293531 Sep 01 14:07:44.930508 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-edae5483-0d90-4abb-a73a-e72e688420c1 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:44.931372 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-edae5483-0d90-4abb-a73a-e72e688420c1 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 91814986-adf4-46cb-8edf-820106d37ecb] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:44.931504 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 96/200] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:44 2022] GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5 => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:07:44.939346 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-edae5483-0d90-4abb-a73a-e72e688420c1 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:44.940710 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-edae5483-0d90-4abb-a73a-e72e688420c1 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:44.941282 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-edae5483-0d90-4abb-a73a-e72e688420c1 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:44.942169 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-edae5483-0d90-4abb-a73a-e72e688420c1 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:44.942770 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-edae5483-0d90-4abb-a73a-e72e688420c1 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:44.945610 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-edae5483-0d90-4abb-a73a-e72e688420c1 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:45.087881 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-edae5483-0d90-4abb-a73a-e72e688420c1 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:45.095879 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-edae5483-0d90-4abb-a73a-e72e688420c1 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb" status: 200 len: 1368 microversion: 2.1 time: 0.168957 Sep 01 14:07:45.096469 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 105/201] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:44 2022] GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:45.952703 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-028f24e1-5ee4-426c-8cc0-4ab05cd85e08 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:45.953625 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-028f24e1-5ee4-426c-8cc0-4ab05cd85e08 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] [instance: 7e0f8565-bc64-439c-be78-3385624198b5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:45.960404 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-ee0e8b33-46f2-42f9-93db-81045b2caef0 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:45.961371 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-028f24e1-5ee4-426c-8cc0-4ab05cd85e08 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:45.961566 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-ee0e8b33-46f2-42f9-93db-81045b2caef0 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 846e670d-c808-44d5-be0e-9c36671fbe91] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:45.961740 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-028f24e1-5ee4-426c-8cc0-4ab05cd85e08 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:45.961740 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-028f24e1-5ee4-426c-8cc0-4ab05cd85e08 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:45.963243 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-028f24e1-5ee4-426c-8cc0-4ab05cd85e08 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:45.965442 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-028f24e1-5ee4-426c-8cc0-4ab05cd85e08 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:45.965962 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-028f24e1-5ee4-426c-8cc0-4ab05cd85e08 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:45.967859 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ee0e8b33-46f2-42f9-93db-81045b2caef0 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:45.968366 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ee0e8b33-46f2-42f9-93db-81045b2caef0 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:45.968826 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ee0e8b33-46f2-42f9-93db-81045b2caef0 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:45.969524 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ee0e8b33-46f2-42f9-93db-81045b2caef0 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:45.970014 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ee0e8b33-46f2-42f9-93db-81045b2caef0 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:45.970440 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ee0e8b33-46f2-42f9-93db-81045b2caef0 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:46.290327 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-028f24e1-5ee4-426c-8cc0-4ab05cd85e08 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446af6bea953401ead7e8a9c9604d8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c13f664f15145fdb9b3c4b9f8496d80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:46.295816 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-ee0e8b33-46f2-42f9-93db-81045b2caef0 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:46.305530 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-028f24e1-5ee4-426c-8cc0-4ab05cd85e08 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5" status: 200 len: 1314 microversion: 2.1 time: 0.356593 Sep 01 14:07:46.307096 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 97/202] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:45 2022] GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5 => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:07:46.322774 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-13a18875-7ecd-4e60-a2c4-d3d5b5284c22 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:46.322774 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-13a18875-7ecd-4e60-a2c4-d3d5b5284c22 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 91814986-adf4-46cb-8edf-820106d37ecb] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:46.322774 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-13a18875-7ecd-4e60-a2c4-d3d5b5284c22 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:46.322774 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-13a18875-7ecd-4e60-a2c4-d3d5b5284c22 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:46.323941 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-13a18875-7ecd-4e60-a2c4-d3d5b5284c22 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:46.324541 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-13a18875-7ecd-4e60-a2c4-d3d5b5284c22 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:46.325251 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-13a18875-7ecd-4e60-a2c4-d3d5b5284c22 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:46.326126 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-13a18875-7ecd-4e60-a2c4-d3d5b5284c22 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:46.344509 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-ee0e8b33-46f2-42f9-93db-81045b2caef0 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91" status: 200 len: 1522 microversion: 2.1 time: 0.387028 Sep 01 14:07:46.358583 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 106/203] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:45 2022] GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91 => generated 1522 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:07:46.501799 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-13a18875-7ecd-4e60-a2c4-d3d5b5284c22 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:46.511047 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-13a18875-7ecd-4e60-a2c4-d3d5b5284c22 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb" status: 200 len: 1368 microversion: 2.1 time: 0.202610 Sep 01 14:07:46.511855 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 98/204] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:46 2022] GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb => generated 1368 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:46.643058 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [req-5a5ed08d-690f-44a1-861a-4510eb7500de req-a36c73fd-a8b7-4046-a4bf-99f183099aee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91814986-adf4-46cb-8edf-820106d37ecb", "tag": "e0564e10-4a1c-482b-8355-e8813807b5bd"}]} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:07:46.652897 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-5a5ed08d-690f-44a1-861a-4510eb7500de req-a36c73fd-a8b7-4046-a4bf-99f183099aee service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:46.653489 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-5a5ed08d-690f-44a1-861a-4510eb7500de req-a36c73fd-a8b7-4046-a4bf-99f183099aee service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:46.654021 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-5a5ed08d-690f-44a1-861a-4510eb7500de req-a36c73fd-a8b7-4046-a4bf-99f183099aee service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:46.665194 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.compute.server_external_events [req-5a5ed08d-690f-44a1-861a-4510eb7500de req-a36c73fd-a8b7-4046-a4bf-99f183099aee service nova] Creating event network-changed:e0564e10-4a1c-482b-8355-e8813807b5bd for instance 91814986-adf4-46cb-8edf-820106d37ecb on hv-cinder-85221 Sep 01 14:07:46.670433 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [req-5a5ed08d-690f-44a1-861a-4510eb7500de req-a36c73fd-a8b7-4046-a4bf-99f183099aee service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031695 Sep 01 14:07:46.671205 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 107/205] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:07:47.353139 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-3fa52cb9-f8e8-4253-be3f-1c72f796c4b2 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:47.353838 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-3fa52cb9-f8e8-4253-be3f-1c72f796c4b2 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] [instance: 7e0f8565-bc64-439c-be78-3385624198b5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:47.355879 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell0:SELECT=4 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:47.356585 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell0:SELECT=20 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:47.363829 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3fa52cb9-f8e8-4253-be3f-1c72f796c4b2 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:47.364330 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3fa52cb9-f8e8-4253-be3f-1c72f796c4b2 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:47.364767 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3fa52cb9-f8e8-4253-be3f-1c72f796c4b2 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:47.365489 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3fa52cb9-f8e8-4253-be3f-1c72f796c4b2 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:47.365967 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3fa52cb9-f8e8-4253-be3f-1c72f796c4b2 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:47.366617 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3fa52cb9-f8e8-4253-be3f-1c72f796c4b2 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:47.393796 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-78c59323-60c1-494a-9907-4bb48ac31eff tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:47.397389 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:47.398084 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-78c59323-60c1-494a-9907-4bb48ac31eff tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 846e670d-c808-44d5-be0e-9c36671fbe91] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:47.414440 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-78c59323-60c1-494a-9907-4bb48ac31eff tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:47.415859 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-78c59323-60c1-494a-9907-4bb48ac31eff tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:47.417534 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-78c59323-60c1-494a-9907-4bb48ac31eff tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:47.421475 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-78c59323-60c1-494a-9907-4bb48ac31eff tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:47.421475 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-78c59323-60c1-494a-9907-4bb48ac31eff tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:47.421475 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-78c59323-60c1-494a-9907-4bb48ac31eff tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:47.723816 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-3fa52cb9-f8e8-4253-be3f-1c72f796c4b2 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446af6bea953401ead7e8a9c9604d8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c13f664f15145fdb9b3c4b9f8496d80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:47.737954 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-3fa52cb9-f8e8-4253-be3f-1c72f796c4b2 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5" status: 200 len: 1314 microversion: 2.1 time: 0.389485 Sep 01 14:07:47.738544 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 99/206] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:47 2022] GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5 => generated 1314 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:07:47.754463 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-c44ef0c8-e54b-4c56-b263-b3cc595b6430 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:47.757141 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-c44ef0c8-e54b-4c56-b263-b3cc595b6430 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 91814986-adf4-46cb-8edf-820106d37ecb] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:47.770606 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c44ef0c8-e54b-4c56-b263-b3cc595b6430 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:47.771876 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c44ef0c8-e54b-4c56-b263-b3cc595b6430 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:47.773826 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c44ef0c8-e54b-4c56-b263-b3cc595b6430 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:47.774054 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-78c59323-60c1-494a-9907-4bb48ac31eff tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:47.775879 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c44ef0c8-e54b-4c56-b263-b3cc595b6430 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:47.778620 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c44ef0c8-e54b-4c56-b263-b3cc595b6430 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:47.786484 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c44ef0c8-e54b-4c56-b263-b3cc595b6430 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:47.793100 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-78c59323-60c1-494a-9907-4bb48ac31eff tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91" status: 200 len: 1522 microversion: 2.1 time: 0.414143 Sep 01 14:07:47.795728 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 108/207] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:47 2022] GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91 => generated 1522 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:48.023748 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-c44ef0c8-e54b-4c56-b263-b3cc595b6430 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:48.035126 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-c44ef0c8-e54b-4c56-b263-b3cc595b6430 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb" status: 200 len: 1368 microversion: 2.1 time: 0.292260 Sep 01 14:07:48.035708 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 100/208] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:47 2022] GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb => generated 1368 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:48.767538 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-56dc1149-66a1-4e3b-be73-c75ae2805f26 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:48.769395 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-56dc1149-66a1-4e3b-be73-c75ae2805f26 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] [instance: 7e0f8565-bc64-439c-be78-3385624198b5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:48.772225 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell0:SELECT=4 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:48.777794 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-56dc1149-66a1-4e3b-be73-c75ae2805f26 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:48.778324 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-56dc1149-66a1-4e3b-be73-c75ae2805f26 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:48.778770 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-56dc1149-66a1-4e3b-be73-c75ae2805f26 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:48.779530 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-56dc1149-66a1-4e3b-be73-c75ae2805f26 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:48.779991 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-56dc1149-66a1-4e3b-be73-c75ae2805f26 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:48.780468 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-56dc1149-66a1-4e3b-be73-c75ae2805f26 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:48.825360 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-c6c830e8-7b9c-49d9-a6b6-f2f73c95361a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:48.826323 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-c6c830e8-7b9c-49d9-a6b6-f2f73c95361a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 846e670d-c808-44d5-be0e-9c36671fbe91] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:48.842212 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c6c830e8-7b9c-49d9-a6b6-f2f73c95361a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:48.842212 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c6c830e8-7b9c-49d9-a6b6-f2f73c95361a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:48.842212 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c6c830e8-7b9c-49d9-a6b6-f2f73c95361a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:48.842212 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c6c830e8-7b9c-49d9-a6b6-f2f73c95361a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:48.848696 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c6c830e8-7b9c-49d9-a6b6-f2f73c95361a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:48.848696 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c6c830e8-7b9c-49d9-a6b6-f2f73c95361a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:49.015479 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-56dc1149-66a1-4e3b-be73-c75ae2805f26 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446af6bea953401ead7e8a9c9604d8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c13f664f15145fdb9b3c4b9f8496d80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:49.027159 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-56dc1149-66a1-4e3b-be73-c75ae2805f26 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5" status: 200 len: 1314 microversion: 2.1 time: 0.263641 Sep 01 14:07:49.028165 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 109/209] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:48 2022] GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5 => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:49.044300 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-c6c830e8-7b9c-49d9-a6b6-f2f73c95361a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:49.052766 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-c6c830e8-7b9c-49d9-a6b6-f2f73c95361a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91" status: 200 len: 1522 microversion: 2.1 time: 0.237811 Sep 01 14:07:49.053351 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 101/210] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:48 2022] GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:07:49.057403 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-09f03b97-6dc4-46bd-9f75-eb608026d1d1 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:49.058039 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-09f03b97-6dc4-46bd-9f75-eb608026d1d1 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 91814986-adf4-46cb-8edf-820106d37ecb] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:49.065656 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-09f03b97-6dc4-46bd-9f75-eb608026d1d1 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:49.066521 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-09f03b97-6dc4-46bd-9f75-eb608026d1d1 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:49.067215 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-09f03b97-6dc4-46bd-9f75-eb608026d1d1 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:49.068059 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-09f03b97-6dc4-46bd-9f75-eb608026d1d1 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:49.068580 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-09f03b97-6dc4-46bd-9f75-eb608026d1d1 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:49.069223 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-09f03b97-6dc4-46bd-9f75-eb608026d1d1 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:49.231563 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-09f03b97-6dc4-46bd-9f75-eb608026d1d1 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:49.240313 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-09f03b97-6dc4-46bd-9f75-eb608026d1d1 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb" status: 200 len: 1368 microversion: 2.1 time: 0.186930 Sep 01 14:07:49.241978 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 110/211] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:49 2022] GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb => generated 1368 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:07:50.055005 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-f4ea538e-6255-414a-9ec7-d13f33780782 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:50.055613 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-f4ea538e-6255-414a-9ec7-d13f33780782 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] [instance: 7e0f8565-bc64-439c-be78-3385624198b5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:50.061746 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f4ea538e-6255-414a-9ec7-d13f33780782 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:50.062255 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f4ea538e-6255-414a-9ec7-d13f33780782 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:50.062680 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f4ea538e-6255-414a-9ec7-d13f33780782 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:50.063370 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f4ea538e-6255-414a-9ec7-d13f33780782 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:50.063813 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f4ea538e-6255-414a-9ec7-d13f33780782 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:50.064231 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f4ea538e-6255-414a-9ec7-d13f33780782 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:50.078320 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-e7f15dac-58b2-40f8-b6bd-9c7bb938f70f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:50.078934 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-e7f15dac-58b2-40f8-b6bd-9c7bb938f70f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 846e670d-c808-44d5-be0e-9c36671fbe91] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:50.086448 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e7f15dac-58b2-40f8-b6bd-9c7bb938f70f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:50.088202 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e7f15dac-58b2-40f8-b6bd-9c7bb938f70f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:50.088202 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e7f15dac-58b2-40f8-b6bd-9c7bb938f70f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:50.088202 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e7f15dac-58b2-40f8-b6bd-9c7bb938f70f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:50.088666 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e7f15dac-58b2-40f8-b6bd-9c7bb938f70f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:50.089090 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e7f15dac-58b2-40f8-b6bd-9c7bb938f70f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:50.278300 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-f4ea538e-6255-414a-9ec7-d13f33780782 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446af6bea953401ead7e8a9c9604d8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c13f664f15145fdb9b3c4b9f8496d80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:50.284005 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-f4ea538e-6255-414a-9ec7-d13f33780782 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5" status: 200 len: 1314 microversion: 2.1 time: 0.234659 Sep 01 14:07:50.284779 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 102/212] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:50 2022] GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:07:50.289579 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-e7f15dac-58b2-40f8-b6bd-9c7bb938f70f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:50.299489 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-66bb58b7-3b9c-4234-816f-bfafb6f21925 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:50.299489 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-66bb58b7-3b9c-4234-816f-bfafb6f21925 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 91814986-adf4-46cb-8edf-820106d37ecb] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:50.300466 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-66bb58b7-3b9c-4234-816f-bfafb6f21925 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:50.301022 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-66bb58b7-3b9c-4234-816f-bfafb6f21925 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:50.301532 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-66bb58b7-3b9c-4234-816f-bfafb6f21925 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:50.302354 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-66bb58b7-3b9c-4234-816f-bfafb6f21925 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:50.303013 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-66bb58b7-3b9c-4234-816f-bfafb6f21925 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:50.303374 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-66bb58b7-3b9c-4234-816f-bfafb6f21925 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:50.303735 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-e7f15dac-58b2-40f8-b6bd-9c7bb938f70f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91" status: 200 len: 1522 microversion: 2.1 time: 0.230131 Sep 01 14:07:50.304323 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 111/213] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:50 2022] GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:07:50.448963 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-66bb58b7-3b9c-4234-816f-bfafb6f21925 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:50.457478 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-66bb58b7-3b9c-4234-816f-bfafb6f21925 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb" status: 200 len: 1368 microversion: 2.1 time: 0.171629 Sep 01 14:07:50.458110 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 103/214] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:50 2022] GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:50.668892 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-b5880bef-3cff-462f-a696-fe5757b3952a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:50.669381 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-b5880bef-3cff-462f-a696-fe5757b3952a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:50.676179 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b5880bef-3cff-462f-a696-fe5757b3952a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:50.676659 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b5880bef-3cff-462f-a696-fe5757b3952a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:50.677084 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b5880bef-3cff-462f-a696-fe5757b3952a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:50.677771 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b5880bef-3cff-462f-a696-fe5757b3952a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:50.678234 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b5880bef-3cff-462f-a696-fe5757b3952a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:50.678650 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b5880bef-3cff-462f-a696-fe5757b3952a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:50.681088 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell1:SELECT=100 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:50.702746 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-b5880bef-3cff-462f-a696-fe5757b3952a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71/ips" status: 200 len: 152 microversion: 2.20 time: 0.037726 Sep 01 14:07:50.709218 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 112/215] 10.222.0.25 () {60 vars in 1289 bytes} [Thu Sep 1 14:07:50 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 14:07:51.308994 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-a6d99351-d053-45db-9a72-2ce8e77af748 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:51.319678 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-a6d99351-d053-45db-9a72-2ce8e77af748 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] [instance: 7e0f8565-bc64-439c-be78-3385624198b5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:51.319678 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a6d99351-d053-45db-9a72-2ce8e77af748 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:51.319678 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a6d99351-d053-45db-9a72-2ce8e77af748 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:51.319678 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a6d99351-d053-45db-9a72-2ce8e77af748 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:51.320188 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a6d99351-d053-45db-9a72-2ce8e77af748 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:51.320188 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a6d99351-d053-45db-9a72-2ce8e77af748 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:51.320188 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a6d99351-d053-45db-9a72-2ce8e77af748 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:51.328028 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-aba75232-402e-44e2-8601-d2ce54f13f25 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:51.341435 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-aba75232-402e-44e2-8601-d2ce54f13f25 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 846e670d-c808-44d5-be0e-9c36671fbe91] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:51.341435 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-aba75232-402e-44e2-8601-d2ce54f13f25 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:51.341435 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-aba75232-402e-44e2-8601-d2ce54f13f25 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:51.341435 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-aba75232-402e-44e2-8601-d2ce54f13f25 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:51.341853 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-aba75232-402e-44e2-8601-d2ce54f13f25 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:51.341853 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-aba75232-402e-44e2-8601-d2ce54f13f25 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:51.341853 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-aba75232-402e-44e2-8601-d2ce54f13f25 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:51.566081 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-a6d99351-d053-45db-9a72-2ce8e77af748 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446af6bea953401ead7e8a9c9604d8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c13f664f15145fdb9b3c4b9f8496d80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:51.574569 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-a6d99351-d053-45db-9a72-2ce8e77af748 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5" status: 200 len: 1314 microversion: 2.1 time: 0.269551 Sep 01 14:07:51.579934 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 104/216] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:51 2022] GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:51.580089 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-aba75232-402e-44e2-8601-d2ce54f13f25 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:51.581881 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-cdb61bd1-2ef3-43d0-9442-abd2071d18fb tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:51.584134 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-cdb61bd1-2ef3-43d0-9442-abd2071d18fb tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 91814986-adf4-46cb-8edf-820106d37ecb] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:51.590665 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-cdb61bd1-2ef3-43d0-9442-abd2071d18fb tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:51.591209 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-cdb61bd1-2ef3-43d0-9442-abd2071d18fb tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:51.591637 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-cdb61bd1-2ef3-43d0-9442-abd2071d18fb tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:51.592337 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-cdb61bd1-2ef3-43d0-9442-abd2071d18fb tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:51.592819 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-cdb61bd1-2ef3-43d0-9442-abd2071d18fb tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:51.593236 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-cdb61bd1-2ef3-43d0-9442-abd2071d18fb tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:51.607166 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-aba75232-402e-44e2-8601-d2ce54f13f25 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91" status: 200 len: 1522 microversion: 2.1 time: 0.283863 Sep 01 14:07:51.607762 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 113/217] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:51 2022] GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91 => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:07:51.778835 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-cdb61bd1-2ef3-43d0-9442-abd2071d18fb tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:51.788167 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-cdb61bd1-2ef3-43d0-9442-abd2071d18fb tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb" status: 200 len: 1368 microversion: 2.1 time: 0.211213 Sep 01 14:07:51.788768 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 105/218] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:51 2022] GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb => generated 1368 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:52.602449 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-505d2b2b-6213-4336-a230-e85ab10a4d05 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:52.603263 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-505d2b2b-6213-4336-a230-e85ab10a4d05 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] [instance: 7e0f8565-bc64-439c-be78-3385624198b5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:52.613281 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-505d2b2b-6213-4336-a230-e85ab10a4d05 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:52.614166 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-505d2b2b-6213-4336-a230-e85ab10a4d05 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:52.615018 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-505d2b2b-6213-4336-a230-e85ab10a4d05 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:52.616313 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-505d2b2b-6213-4336-a230-e85ab10a4d05 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:52.617144 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-505d2b2b-6213-4336-a230-e85ab10a4d05 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:52.617929 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-505d2b2b-6213-4336-a230-e85ab10a4d05 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:52.635296 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-8b0cd86f-b308-458f-9ff3-be28b791255d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:52.636225 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-8b0cd86f-b308-458f-9ff3-be28b791255d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 846e670d-c808-44d5-be0e-9c36671fbe91] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:52.647309 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8b0cd86f-b308-458f-9ff3-be28b791255d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:52.648257 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8b0cd86f-b308-458f-9ff3-be28b791255d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:52.649212 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8b0cd86f-b308-458f-9ff3-be28b791255d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:52.650530 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8b0cd86f-b308-458f-9ff3-be28b791255d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:52.651405 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8b0cd86f-b308-458f-9ff3-be28b791255d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:52.652380 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8b0cd86f-b308-458f-9ff3-be28b791255d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:52.855194 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-505d2b2b-6213-4336-a230-e85ab10a4d05 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446af6bea953401ead7e8a9c9604d8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c13f664f15145fdb9b3c4b9f8496d80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:52.864107 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-505d2b2b-6213-4336-a230-e85ab10a4d05 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5" status: 200 len: 1314 microversion: 2.1 time: 0.267400 Sep 01 14:07:52.864693 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 114/219] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:52 2022] GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5 => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:52.874217 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-8b0cd86f-b308-458f-9ff3-be28b791255d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:52.876465 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-d6bbdc47-0d1a-42ca-979a-7b48b4a5c736 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:52.877149 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-d6bbdc47-0d1a-42ca-979a-7b48b4a5c736 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 91814986-adf4-46cb-8edf-820106d37ecb] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:52.879798 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-8b0cd86f-b308-458f-9ff3-be28b791255d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91" status: 200 len: 1522 microversion: 2.1 time: 0.250025 Sep 01 14:07:52.887325 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 106/220] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:52 2022] GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91 => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:52.889933 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d6bbdc47-0d1a-42ca-979a-7b48b4a5c736 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:52.890486 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d6bbdc47-0d1a-42ca-979a-7b48b4a5c736 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:52.894252 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d6bbdc47-0d1a-42ca-979a-7b48b4a5c736 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:52.894252 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d6bbdc47-0d1a-42ca-979a-7b48b4a5c736 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:52.894252 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d6bbdc47-0d1a-42ca-979a-7b48b4a5c736 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:52.894252 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d6bbdc47-0d1a-42ca-979a-7b48b4a5c736 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:53.035319 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-d6bbdc47-0d1a-42ca-979a-7b48b4a5c736 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:53.044235 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-d6bbdc47-0d1a-42ca-979a-7b48b4a5c736 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb" status: 200 len: 1368 microversion: 2.1 time: 0.178202 Sep 01 14:07:53.049573 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 115/221] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:52 2022] GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb => generated 1368 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:53.884704 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-a0e3f0f3-0d84-4fe5-8acd-f4ec7996d9d0 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:53.885331 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-a0e3f0f3-0d84-4fe5-8acd-f4ec7996d9d0 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] [instance: 7e0f8565-bc64-439c-be78-3385624198b5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:53.891627 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a0e3f0f3-0d84-4fe5-8acd-f4ec7996d9d0 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:53.892104 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a0e3f0f3-0d84-4fe5-8acd-f4ec7996d9d0 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:53.892533 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a0e3f0f3-0d84-4fe5-8acd-f4ec7996d9d0 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:53.894002 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a0e3f0f3-0d84-4fe5-8acd-f4ec7996d9d0 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:53.894451 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a0e3f0f3-0d84-4fe5-8acd-f4ec7996d9d0 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:53.894863 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a0e3f0f3-0d84-4fe5-8acd-f4ec7996d9d0 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:53.900878 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-cb8b84da-4cf9-478a-957c-b26c2d3bf081 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:53.901488 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-cb8b84da-4cf9-478a-957c-b26c2d3bf081 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 846e670d-c808-44d5-be0e-9c36671fbe91] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:53.908182 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-cb8b84da-4cf9-478a-957c-b26c2d3bf081 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:53.908711 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-cb8b84da-4cf9-478a-957c-b26c2d3bf081 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:53.909151 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-cb8b84da-4cf9-478a-957c-b26c2d3bf081 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:53.909851 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-cb8b84da-4cf9-478a-957c-b26c2d3bf081 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:53.910334 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-cb8b84da-4cf9-478a-957c-b26c2d3bf081 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:53.910754 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-cb8b84da-4cf9-478a-957c-b26c2d3bf081 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:54.113314 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-a0e3f0f3-0d84-4fe5-8acd-f4ec7996d9d0 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446af6bea953401ead7e8a9c9604d8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c13f664f15145fdb9b3c4b9f8496d80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:54.113314 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-a0e3f0f3-0d84-4fe5-8acd-f4ec7996d9d0 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5" status: 200 len: 1314 microversion: 2.1 time: 0.230430 Sep 01 14:07:54.113314 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 107/222] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:53 2022] GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:54.114739 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-cb8b84da-4cf9-478a-957c-b26c2d3bf081 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:54.120394 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-da566596-0abb-4929-83d5-ab1c0d1bf455 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:54.121033 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-da566596-0abb-4929-83d5-ab1c0d1bf455 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 91814986-adf4-46cb-8edf-820106d37ecb] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:54.128425 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-da566596-0abb-4929-83d5-ab1c0d1bf455 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:54.129026 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-da566596-0abb-4929-83d5-ab1c0d1bf455 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:54.129780 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-da566596-0abb-4929-83d5-ab1c0d1bf455 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:54.130684 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-da566596-0abb-4929-83d5-ab1c0d1bf455 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:54.131310 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-da566596-0abb-4929-83d5-ab1c0d1bf455 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:54.131734 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-da566596-0abb-4929-83d5-ab1c0d1bf455 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:54.136525 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-cb8b84da-4cf9-478a-957c-b26c2d3bf081 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91" status: 200 len: 1522 microversion: 2.1 time: 0.239409 Sep 01 14:07:54.137473 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 116/223] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:53 2022] GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:07:54.301405 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-da566596-0abb-4929-83d5-ab1c0d1bf455 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:54.310173 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-da566596-0abb-4929-83d5-ab1c0d1bf455 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb" status: 200 len: 1368 microversion: 2.1 time: 0.195921 Sep 01 14:07:54.310762 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 108/224] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:54 2022] GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb => generated 1368 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:55.139314 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-7143eab6-0681-4976-a49e-b61e0e12f957 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:55.139860 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-7143eab6-0681-4976-a49e-b61e0e12f957 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] [instance: 7e0f8565-bc64-439c-be78-3385624198b5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:55.147246 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7143eab6-0681-4976-a49e-b61e0e12f957 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:55.147730 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7143eab6-0681-4976-a49e-b61e0e12f957 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:55.148175 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7143eab6-0681-4976-a49e-b61e0e12f957 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:55.148888 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7143eab6-0681-4976-a49e-b61e0e12f957 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:55.149348 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7143eab6-0681-4976-a49e-b61e0e12f957 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:55.149770 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7143eab6-0681-4976-a49e-b61e0e12f957 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:55.161155 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-dfa62d8f-47af-421d-a613-8576bcbead84 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:55.162102 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-dfa62d8f-47af-421d-a613-8576bcbead84 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 846e670d-c808-44d5-be0e-9c36671fbe91] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:55.176406 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-dfa62d8f-47af-421d-a613-8576bcbead84 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:55.176833 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-dfa62d8f-47af-421d-a613-8576bcbead84 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:55.177263 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-dfa62d8f-47af-421d-a613-8576bcbead84 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:55.177988 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-dfa62d8f-47af-421d-a613-8576bcbead84 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:55.178602 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-dfa62d8f-47af-421d-a613-8576bcbead84 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:55.179030 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-dfa62d8f-47af-421d-a613-8576bcbead84 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:55.364545 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-7143eab6-0681-4976-a49e-b61e0e12f957 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446af6bea953401ead7e8a9c9604d8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c13f664f15145fdb9b3c4b9f8496d80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:55.376508 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-7143eab6-0681-4976-a49e-b61e0e12f957 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5" status: 200 len: 1314 microversion: 2.1 time: 0.241332 Sep 01 14:07:55.377173 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 117/225] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:55 2022] GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:55.382045 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-7d669ef2-886c-4fc0-ac5a-0178a742b761 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:55.382669 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-7d669ef2-886c-4fc0-ac5a-0178a742b761 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 91814986-adf4-46cb-8edf-820106d37ecb] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:55.389248 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7d669ef2-886c-4fc0-ac5a-0178a742b761 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:55.389820 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7d669ef2-886c-4fc0-ac5a-0178a742b761 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:55.390201 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7d669ef2-886c-4fc0-ac5a-0178a742b761 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:55.391043 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7d669ef2-886c-4fc0-ac5a-0178a742b761 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:55.391706 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7d669ef2-886c-4fc0-ac5a-0178a742b761 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:55.391839 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-dfa62d8f-47af-421d-a613-8576bcbead84 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:55.392427 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7d669ef2-886c-4fc0-ac5a-0178a742b761 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:55.406594 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-dfa62d8f-47af-421d-a613-8576bcbead84 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91" status: 200 len: 1522 microversion: 2.1 time: 0.251277 Sep 01 14:07:55.407628 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 109/226] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:55 2022] GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91 => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:55.562251 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-7d669ef2-886c-4fc0-ac5a-0178a742b761 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:55.575705 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-7d669ef2-886c-4fc0-ac5a-0178a742b761 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb" status: 200 len: 1368 microversion: 2.1 time: 0.197159 Sep 01 14:07:55.576852 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 118/227] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:55 2022] GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb => generated 1368 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:56.216893 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [req-78a01368-84ee-43b6-b05a-68ada105e901 req-2c98b18f-917c-4874-8abe-e27076434cf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e0f8565-bc64-439c-be78-3385624198b5", "name": "network-vif-plugged", "status": "completed", "tag": "567f782a-6b5e-4df4-9763-c0f2c4ed650f"}]} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:07:56.235327 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-78a01368-84ee-43b6-b05a-68ada105e901 req-2c98b18f-917c-4874-8abe-e27076434cf1 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:56.235996 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-78a01368-84ee-43b6-b05a-68ada105e901 req-2c98b18f-917c-4874-8abe-e27076434cf1 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:56.236738 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-78a01368-84ee-43b6-b05a-68ada105e901 req-2c98b18f-917c-4874-8abe-e27076434cf1 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:56.252508 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.compute.server_external_events [req-78a01368-84ee-43b6-b05a-68ada105e901 req-2c98b18f-917c-4874-8abe-e27076434cf1 service nova] Creating event network-vif-plugged:567f782a-6b5e-4df4-9763-c0f2c4ed650f for instance 7e0f8565-bc64-439c-be78-3385624198b5 on hv-cinder-85221 Sep 01 14:07:56.261203 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [req-78a01368-84ee-43b6-b05a-68ada105e901 req-2c98b18f-917c-4874-8abe-e27076434cf1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050581 Sep 01 14:07:56.262442 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 110/228] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:07:56.398710 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-7b1b3652-2a33-439b-adf2-e76cb161732d tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:56.399417 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-7b1b3652-2a33-439b-adf2-e76cb161732d tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] [instance: 7e0f8565-bc64-439c-be78-3385624198b5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:56.405979 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7b1b3652-2a33-439b-adf2-e76cb161732d tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:56.406465 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7b1b3652-2a33-439b-adf2-e76cb161732d tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:56.406892 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7b1b3652-2a33-439b-adf2-e76cb161732d tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:56.407644 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7b1b3652-2a33-439b-adf2-e76cb161732d tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:56.408049 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7b1b3652-2a33-439b-adf2-e76cb161732d tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:56.408494 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7b1b3652-2a33-439b-adf2-e76cb161732d tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:56.450170 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-98a11fc3-8974-42d6-90d6-5874753c70c4 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:56.450170 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-98a11fc3-8974-42d6-90d6-5874753c70c4 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 846e670d-c808-44d5-be0e-9c36671fbe91] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:56.462104 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-98a11fc3-8974-42d6-90d6-5874753c70c4 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:56.462928 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-98a11fc3-8974-42d6-90d6-5874753c70c4 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:56.463501 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-98a11fc3-8974-42d6-90d6-5874753c70c4 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:56.464673 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-98a11fc3-8974-42d6-90d6-5874753c70c4 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:56.465481 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-98a11fc3-8974-42d6-90d6-5874753c70c4 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:56.466389 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-98a11fc3-8974-42d6-90d6-5874753c70c4 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:56.599659 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-7b1b3652-2a33-439b-adf2-e76cb161732d tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446af6bea953401ead7e8a9c9604d8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c13f664f15145fdb9b3c4b9f8496d80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:56.609380 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-7b1b3652-2a33-439b-adf2-e76cb161732d tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5" status: 200 len: 1314 microversion: 2.1 time: 0.214443 Sep 01 14:07:56.614053 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 119/229] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:56 2022] GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:56.618479 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-2dd612af-2e3a-4874-9c10-7b7e1ce9a435 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:56.619098 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-2dd612af-2e3a-4874-9c10-7b7e1ce9a435 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 91814986-adf4-46cb-8edf-820106d37ecb] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:56.641447 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2dd612af-2e3a-4874-9c10-7b7e1ce9a435 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:56.641956 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2dd612af-2e3a-4874-9c10-7b7e1ce9a435 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:56.642396 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2dd612af-2e3a-4874-9c10-7b7e1ce9a435 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:56.643435 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2dd612af-2e3a-4874-9c10-7b7e1ce9a435 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:56.644114 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2dd612af-2e3a-4874-9c10-7b7e1ce9a435 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:56.652545 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2dd612af-2e3a-4874-9c10-7b7e1ce9a435 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:56.729293 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-98a11fc3-8974-42d6-90d6-5874753c70c4 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:56.739034 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-98a11fc3-8974-42d6-90d6-5874753c70c4 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91" status: 200 len: 1522 microversion: 2.1 time: 0.299896 Sep 01 14:07:56.739723 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 111/230] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:56 2022] GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91 => generated 1522 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:07:57.100437 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-2dd612af-2e3a-4874-9c10-7b7e1ce9a435 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:57.108453 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-2dd612af-2e3a-4874-9c10-7b7e1ce9a435 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb" status: 200 len: 1368 microversion: 2.1 time: 0.496962 Sep 01 14:07:57.109039 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 120/231] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:56 2022] GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb => generated 1368 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:57.641064 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-c97f109f-aa2d-43e1-8476-48104eb83870 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:57.641866 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-c97f109f-aa2d-43e1-8476-48104eb83870 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] [instance: 7e0f8565-bc64-439c-be78-3385624198b5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:57.648939 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c97f109f-aa2d-43e1-8476-48104eb83870 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:57.649436 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c97f109f-aa2d-43e1-8476-48104eb83870 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:57.649871 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c97f109f-aa2d-43e1-8476-48104eb83870 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:57.650766 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c97f109f-aa2d-43e1-8476-48104eb83870 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:57.651223 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c97f109f-aa2d-43e1-8476-48104eb83870 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:57.651650 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c97f109f-aa2d-43e1-8476-48104eb83870 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:57.760664 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-57f65d75-874e-4460-9862-5aa000fa679e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:57.761997 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-57f65d75-874e-4460-9862-5aa000fa679e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 846e670d-c808-44d5-be0e-9c36671fbe91] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:57.769506 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-57f65d75-874e-4460-9862-5aa000fa679e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:57.770374 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-57f65d75-874e-4460-9862-5aa000fa679e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:57.770956 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-57f65d75-874e-4460-9862-5aa000fa679e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:57.771820 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-57f65d75-874e-4460-9862-5aa000fa679e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:57.772302 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-57f65d75-874e-4460-9862-5aa000fa679e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:57.772718 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-57f65d75-874e-4460-9862-5aa000fa679e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:57.838334 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-c97f109f-aa2d-43e1-8476-48104eb83870 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446af6bea953401ead7e8a9c9604d8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c13f664f15145fdb9b3c4b9f8496d80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:57.848949 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-c97f109f-aa2d-43e1-8476-48104eb83870 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5" status: 200 len: 1314 microversion: 2.1 time: 0.211943 Sep 01 14:07:57.850351 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 112/232] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:57 2022] GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:57.950939 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-57f65d75-874e-4460-9862-5aa000fa679e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:57.960308 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-57f65d75-874e-4460-9862-5aa000fa679e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91" status: 200 len: 1522 microversion: 2.1 time: 0.203443 Sep 01 14:07:57.974024 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 121/233] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:57 2022] GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:07:58.130448 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-8723f91f-f166-4a7a-9674-70e55b36fd13 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:58.130980 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-8723f91f-f166-4a7a-9674-70e55b36fd13 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 91814986-adf4-46cb-8edf-820106d37ecb] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:58.138963 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8723f91f-f166-4a7a-9674-70e55b36fd13 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:58.139646 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8723f91f-f166-4a7a-9674-70e55b36fd13 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:58.140142 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8723f91f-f166-4a7a-9674-70e55b36fd13 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:58.140899 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8723f91f-f166-4a7a-9674-70e55b36fd13 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:58.141677 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8723f91f-f166-4a7a-9674-70e55b36fd13 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:58.142484 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8723f91f-f166-4a7a-9674-70e55b36fd13 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:58.312820 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-8723f91f-f166-4a7a-9674-70e55b36fd13 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:58.320779 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-8723f91f-f166-4a7a-9674-70e55b36fd13 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb" status: 200 len: 1368 microversion: 2.1 time: 0.194895 Sep 01 14:07:58.321357 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 113/234] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:58 2022] GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb => generated 1368 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:58.871339 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-d7ec60bd-0b67-4396-b3ea-e7edc7424350 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:58.873002 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-d7ec60bd-0b67-4396-b3ea-e7edc7424350 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] [instance: 7e0f8565-bc64-439c-be78-3385624198b5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:58.885137 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d7ec60bd-0b67-4396-b3ea-e7edc7424350 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:58.885137 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d7ec60bd-0b67-4396-b3ea-e7edc7424350 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:58.885137 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d7ec60bd-0b67-4396-b3ea-e7edc7424350 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:58.885137 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d7ec60bd-0b67-4396-b3ea-e7edc7424350 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:58.885692 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d7ec60bd-0b67-4396-b3ea-e7edc7424350 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:58.885692 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d7ec60bd-0b67-4396-b3ea-e7edc7424350 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:58.897041 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-c7e3c1e4-e8fe-4881-8985-9d69fdb11a4e tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:07:58.898122 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-c7e3c1e4-e8fe-4881-8985-9d69fdb11a4e tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:58.909227 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c7e3c1e4-e8fe-4881-8985-9d69fdb11a4e tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:58.910277 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c7e3c1e4-e8fe-4881-8985-9d69fdb11a4e tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:58.911125 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c7e3c1e4-e8fe-4881-8985-9d69fdb11a4e tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:58.912906 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c7e3c1e4-e8fe-4881-8985-9d69fdb11a4e tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:58.914577 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c7e3c1e4-e8fe-4881-8985-9d69fdb11a4e tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:58.915605 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c7e3c1e4-e8fe-4881-8985-9d69fdb11a4e tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:58.970426 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.objects.instance [None req-c7e3c1e4-e8fe-4881-8985-9d69fdb11a4e tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lazy-loading 'flavor' on Instance uuid d39f7090-b419-46be-9fcc-7ae73004ab71 {{(pid=121339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:07:59.132129 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-d7ec60bd-0b67-4396-b3ea-e7edc7424350 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446af6bea953401ead7e8a9c9604d8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c13f664f15145fdb9b3c4b9f8496d80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:59.141636 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-d7ec60bd-0b67-4396-b3ea-e7edc7424350 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5" status: 200 len: 1314 microversion: 2.1 time: 0.274523 Sep 01 14:07:59.142267 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 122/235] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:58 2022] GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5 => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:59.148694 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-e32b8cca-5a17-4624-bb09-e1fce41463ec tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:59.149551 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-e32b8cca-5a17-4624-bb09-e1fce41463ec tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 846e670d-c808-44d5-be0e-9c36671fbe91] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:59.156551 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e32b8cca-5a17-4624-bb09-e1fce41463ec tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:59.157311 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e32b8cca-5a17-4624-bb09-e1fce41463ec tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:59.158140 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e32b8cca-5a17-4624-bb09-e1fce41463ec tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:59.159295 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e32b8cca-5a17-4624-bb09-e1fce41463ec tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:59.160032 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e32b8cca-5a17-4624-bb09-e1fce41463ec tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:59.160685 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e32b8cca-5a17-4624-bb09-e1fce41463ec tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:59.374787 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-e32b8cca-5a17-4624-bb09-e1fce41463ec tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:59.384951 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-e32b8cca-5a17-4624-bb09-e1fce41463ec tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91" status: 200 len: 1522 microversion: 2.1 time: 0.240256 Sep 01 14:07:59.385692 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 123/236] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:59 2022] GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:59.403625 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-2acf3953-21cb-4a3d-9557-d2951c3eda4b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:59.403625 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-2acf3953-21cb-4a3d-9557-d2951c3eda4b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 91814986-adf4-46cb-8edf-820106d37ecb] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:59.414908 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2acf3953-21cb-4a3d-9557-d2951c3eda4b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:59.415764 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2acf3953-21cb-4a3d-9557-d2951c3eda4b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:59.416539 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2acf3953-21cb-4a3d-9557-d2951c3eda4b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:59.417774 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2acf3953-21cb-4a3d-9557-d2951c3eda4b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:59.418534 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2acf3953-21cb-4a3d-9557-d2951c3eda4b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:59.419513 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2acf3953-21cb-4a3d-9557-d2951c3eda4b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:59.487218 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:59.590551 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-2acf3953-21cb-4a3d-9557-d2951c3eda4b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:59.599055 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-2acf3953-21cb-4a3d-9557-d2951c3eda4b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb" status: 200 len: 1368 microversion: 2.1 time: 0.211978 Sep 01 14:07:59.599652 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 124/237] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:59 2022] GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb => generated 1368 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:59.725224 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-c7e3c1e4-e8fe-4881-8985-9d69fdb11a4e tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "POST /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71/action" status: 202 len: 0 microversion: 2.20 time: 0.835114 Sep 01 14:07:59.725978 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 114/238] 10.222.0.25 () {62 vars in 1319 bytes} [Thu Sep 1 14:07:58 2022] POST /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71/action => generated 0 bytes in 837 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:07:59.736257 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-9e042662-13a7-48cc-ba52-6a2a2d5f47ab tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:59.737381 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-9e042662-13a7-48cc-ba52-6a2a2d5f47ab tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:59.748559 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9e042662-13a7-48cc-ba52-6a2a2d5f47ab tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:59.749284 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9e042662-13a7-48cc-ba52-6a2a2d5f47ab tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:59.750093 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9e042662-13a7-48cc-ba52-6a2a2d5f47ab tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:59.751387 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9e042662-13a7-48cc-ba52-6a2a2d5f47ab tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:59.752733 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9e042662-13a7-48cc-ba52-6a2a2d5f47ab tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:59.753506 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9e042662-13a7-48cc-ba52-6a2a2d5f47ab tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:59.937687 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-9e042662-13a7-48cc-ba52-6a2a2d5f47ab tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:59.955406 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-9e042662-13a7-48cc-ba52-6a2a2d5f47ab tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:59.955406 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-9e042662-13a7-48cc-ba52-6a2a2d5f47ab tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:59.955406 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-9e042662-13a7-48cc-ba52-6a2a2d5f47ab tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1725 microversion: 2.20 time: 0.218413 Sep 01 14:07:59.956112 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 125/239] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:07:59 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:08:00.136034 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [req-4f1e65bd-0c4f-42c0-a61a-9f3bef58f0cf req-2563486f-5453-408d-b1b1-4065c0a88068 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91814986-adf4-46cb-8edf-820106d37ecb", "name": "network-vif-plugged", "status": "completed", "tag": "e0564e10-4a1c-482b-8355-e8813807b5bd"}]} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:08:00.151734 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-4f1e65bd-0c4f-42c0-a61a-9f3bef58f0cf req-2563486f-5453-408d-b1b1-4065c0a88068 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:00.152275 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-4f1e65bd-0c4f-42c0-a61a-9f3bef58f0cf req-2563486f-5453-408d-b1b1-4065c0a88068 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:00.153018 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-4f1e65bd-0c4f-42c0-a61a-9f3bef58f0cf req-2563486f-5453-408d-b1b1-4065c0a88068 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:00.175341 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.compute.server_external_events [req-4f1e65bd-0c4f-42c0-a61a-9f3bef58f0cf req-2563486f-5453-408d-b1b1-4065c0a88068 service nova] Creating event network-vif-plugged:e0564e10-4a1c-482b-8355-e8813807b5bd for instance 91814986-adf4-46cb-8edf-820106d37ecb on hv-cinder-85221 Sep 01 14:08:00.177070 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [req-4f1e65bd-0c4f-42c0-a61a-9f3bef58f0cf req-2563486f-5453-408d-b1b1-4065c0a88068 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052712 Sep 01 14:08:00.180817 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-ee6f1ed7-80e4-45f4-bb23-32694f159e2e tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:00.182372 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 115/240] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:08:00.183160 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-ee6f1ed7-80e4-45f4-bb23-32694f159e2e tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] [instance: 7e0f8565-bc64-439c-be78-3385624198b5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:00.188293 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_api:SELECT=84 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:00.196196 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ee6f1ed7-80e4-45f4-bb23-32694f159e2e tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:00.196966 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ee6f1ed7-80e4-45f4-bb23-32694f159e2e tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:00.197685 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ee6f1ed7-80e4-45f4-bb23-32694f159e2e tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:00.198762 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ee6f1ed7-80e4-45f4-bb23-32694f159e2e tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:00.201521 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ee6f1ed7-80e4-45f4-bb23-32694f159e2e tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:00.203340 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ee6f1ed7-80e4-45f4-bb23-32694f159e2e tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:00.420677 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-3b0b440b-01ab-476c-a8da-fce7d3d5b4fe tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:00.421375 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-3b0b440b-01ab-476c-a8da-fce7d3d5b4fe tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 846e670d-c808-44d5-be0e-9c36671fbe91] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:00.428484 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3b0b440b-01ab-476c-a8da-fce7d3d5b4fe tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:00.429024 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3b0b440b-01ab-476c-a8da-fce7d3d5b4fe tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:00.429695 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3b0b440b-01ab-476c-a8da-fce7d3d5b4fe tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:00.430460 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3b0b440b-01ab-476c-a8da-fce7d3d5b4fe tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:00.430904 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3b0b440b-01ab-476c-a8da-fce7d3d5b4fe tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:00.431490 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3b0b440b-01ab-476c-a8da-fce7d3d5b4fe tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:00.465500 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-ee6f1ed7-80e4-45f4-bb23-32694f159e2e tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446af6bea953401ead7e8a9c9604d8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c13f664f15145fdb9b3c4b9f8496d80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:00.479217 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-ee6f1ed7-80e4-45f4-bb23-32694f159e2e tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5" status: 200 len: 1464 microversion: 2.1 time: 0.308811 Sep 01 14:08:00.479820 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 126/241] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:00 2022] GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5 => generated 1464 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:00.536363 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-3ecdbb9f-6817-4f0b-a240-72ca7bc67e55 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:00.536955 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-3ecdbb9f-6817-4f0b-a240-72ca7bc67e55 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] [instance: 7e0f8565-bc64-439c-be78-3385624198b5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:00.543870 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3ecdbb9f-6817-4f0b-a240-72ca7bc67e55 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:00.544470 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3ecdbb9f-6817-4f0b-a240-72ca7bc67e55 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:00.544989 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3ecdbb9f-6817-4f0b-a240-72ca7bc67e55 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:00.545806 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3ecdbb9f-6817-4f0b-a240-72ca7bc67e55 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:00.546347 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3ecdbb9f-6817-4f0b-a240-72ca7bc67e55 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:00.546904 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3ecdbb9f-6817-4f0b-a240-72ca7bc67e55 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:00.586758 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-3ecdbb9f-6817-4f0b-a240-72ca7bc67e55 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] [instance: 7e0f8565-bc64-439c-be78-3385624198b5] Going to try to terminate instance {{(pid=121340) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:08:00.629449 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-3b0b440b-01ab-476c-a8da-fce7d3d5b4fe tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:00.638007 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-3b0b440b-01ab-476c-a8da-fce7d3d5b4fe tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91" status: 200 len: 1522 microversion: 2.1 time: 0.221511 Sep 01 14:08:00.638592 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 116/242] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:00 2022] GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:08:00.643839 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-e490ba29-8c44-4c7d-83d9-d2a5b127b0cd tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:00.644751 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-e490ba29-8c44-4c7d-83d9-d2a5b127b0cd tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 91814986-adf4-46cb-8edf-820106d37ecb] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:00.652084 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e490ba29-8c44-4c7d-83d9-d2a5b127b0cd tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:00.652889 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e490ba29-8c44-4c7d-83d9-d2a5b127b0cd tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:00.653352 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e490ba29-8c44-4c7d-83d9-d2a5b127b0cd tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:00.654109 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e490ba29-8c44-4c7d-83d9-d2a5b127b0cd tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:00.654731 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e490ba29-8c44-4c7d-83d9-d2a5b127b0cd tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:00.673691 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e490ba29-8c44-4c7d-83d9-d2a5b127b0cd tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:00.844205 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-e490ba29-8c44-4c7d-83d9-d2a5b127b0cd tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:00.854215 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-e490ba29-8c44-4c7d-83d9-d2a5b127b0cd tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb" status: 200 len: 1368 microversion: 2.1 time: 0.214005 Sep 01 14:08:00.866011 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 117/243] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:00 2022] GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb => generated 1368 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:00.872211 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:00.977417 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-81e9e627-ea58-4865-86bd-47460a601acd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:00.978610 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-81e9e627-ea58-4865-86bd-47460a601acd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:01.004868 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-81e9e627-ea58-4865-86bd-47460a601acd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:01.009222 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-81e9e627-ea58-4865-86bd-47460a601acd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:01.011381 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-81e9e627-ea58-4865-86bd-47460a601acd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:01.011578 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-81e9e627-ea58-4865-86bd-47460a601acd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:01.020713 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-81e9e627-ea58-4865-86bd-47460a601acd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:01.022096 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-81e9e627-ea58-4865-86bd-47460a601acd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:01.208982 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-3ecdbb9f-6817-4f0b-a240-72ca7bc67e55 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5" status: 204 len: 0 microversion: 2.1 time: 0.676367 Sep 01 14:08:01.210363 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 127/244] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 14:08:00 2022] DELETE /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 14:08:01.226087 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-d2534858-dd65-4260-8ac0-da9c0379c4ce tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:01.227969 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-81e9e627-ea58-4865-86bd-47460a601acd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:01.230531 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-d2534858-dd65-4260-8ac0-da9c0379c4ce tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] [instance: 7e0f8565-bc64-439c-be78-3385624198b5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:01.242370 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-81e9e627-ea58-4865-86bd-47460a601acd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:01.245188 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-81e9e627-ea58-4865-86bd-47460a601acd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:01.246730 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d2534858-dd65-4260-8ac0-da9c0379c4ce tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:01.247268 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-81e9e627-ea58-4865-86bd-47460a601acd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1725 microversion: 2.20 time: 0.277021 Sep 01 14:08:01.247491 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d2534858-dd65-4260-8ac0-da9c0379c4ce tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:01.248070 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d2534858-dd65-4260-8ac0-da9c0379c4ce tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:01.248500 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 118/245] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:08:00 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1725 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:08:01.255577 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d2534858-dd65-4260-8ac0-da9c0379c4ce tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:01.256354 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d2534858-dd65-4260-8ac0-da9c0379c4ce tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:01.257686 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d2534858-dd65-4260-8ac0-da9c0379c4ce tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:01.476084 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-d2534858-dd65-4260-8ac0-da9c0379c4ce tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446af6bea953401ead7e8a9c9604d8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c13f664f15145fdb9b3c4b9f8496d80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:01.491750 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-d2534858-dd65-4260-8ac0-da9c0379c4ce tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5" status: 200 len: 1470 microversion: 2.1 time: 0.274392 Sep 01 14:08:01.492795 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 128/246] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:01 2022] GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5 => generated 1470 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:01.671870 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-f6deea57-e1f4-4997-a05f-959e6eeeb3c7 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:01.672562 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-f6deea57-e1f4-4997-a05f-959e6eeeb3c7 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 846e670d-c808-44d5-be0e-9c36671fbe91] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:01.679736 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f6deea57-e1f4-4997-a05f-959e6eeeb3c7 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:01.680230 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f6deea57-e1f4-4997-a05f-959e6eeeb3c7 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:01.680668 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f6deea57-e1f4-4997-a05f-959e6eeeb3c7 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:01.681400 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f6deea57-e1f4-4997-a05f-959e6eeeb3c7 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:01.681865 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f6deea57-e1f4-4997-a05f-959e6eeeb3c7 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:01.682327 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f6deea57-e1f4-4997-a05f-959e6eeeb3c7 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:01.845709 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-f6deea57-e1f4-4997-a05f-959e6eeeb3c7 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:01.855429 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-f6deea57-e1f4-4997-a05f-959e6eeeb3c7 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91" status: 200 len: 1522 microversion: 2.1 time: 0.187923 Sep 01 14:08:01.856071 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 119/247] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:01 2022] GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:08:01.890498 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-6ddbaaac-4576-4888-a851-49942ef065c4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:01.891118 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-6ddbaaac-4576-4888-a851-49942ef065c4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 91814986-adf4-46cb-8edf-820106d37ecb] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:01.899883 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6ddbaaac-4576-4888-a851-49942ef065c4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:01.900381 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6ddbaaac-4576-4888-a851-49942ef065c4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:01.900909 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6ddbaaac-4576-4888-a851-49942ef065c4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:01.901629 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6ddbaaac-4576-4888-a851-49942ef065c4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:01.902124 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6ddbaaac-4576-4888-a851-49942ef065c4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:01.902552 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6ddbaaac-4576-4888-a851-49942ef065c4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:02.081823 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-6ddbaaac-4576-4888-a851-49942ef065c4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:02.090727 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-6ddbaaac-4576-4888-a851-49942ef065c4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb" status: 200 len: 1368 microversion: 2.1 time: 0.204401 Sep 01 14:08:02.091466 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 129/248] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:01 2022] GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb => generated 1368 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:02.286305 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-19984caf-c615-48a9-a518-e4d0eecae73c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:02.286857 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-19984caf-c615-48a9-a518-e4d0eecae73c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:02.294859 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-19984caf-c615-48a9-a518-e4d0eecae73c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:02.295385 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-19984caf-c615-48a9-a518-e4d0eecae73c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:02.295828 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-19984caf-c615-48a9-a518-e4d0eecae73c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:02.296548 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-19984caf-c615-48a9-a518-e4d0eecae73c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:02.297029 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-19984caf-c615-48a9-a518-e4d0eecae73c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:02.297427 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-19984caf-c615-48a9-a518-e4d0eecae73c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:02.515683 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-4b86a2f1-4a65-4afd-920b-a7520c7efcb4 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:02.516702 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-4b86a2f1-4a65-4afd-920b-a7520c7efcb4 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] [instance: 7e0f8565-bc64-439c-be78-3385624198b5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:02.526890 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4b86a2f1-4a65-4afd-920b-a7520c7efcb4 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:02.527649 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4b86a2f1-4a65-4afd-920b-a7520c7efcb4 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:02.528205 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4b86a2f1-4a65-4afd-920b-a7520c7efcb4 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:02.529833 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4b86a2f1-4a65-4afd-920b-a7520c7efcb4 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:02.530879 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4b86a2f1-4a65-4afd-920b-a7520c7efcb4 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:02.531601 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4b86a2f1-4a65-4afd-920b-a7520c7efcb4 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:02.566018 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-19984caf-c615-48a9-a518-e4d0eecae73c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:02.576690 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-19984caf-c615-48a9-a518-e4d0eecae73c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:02.578836 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-19984caf-c615-48a9-a518-e4d0eecae73c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:02.581198 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-19984caf-c615-48a9-a518-e4d0eecae73c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1725 microversion: 2.20 time: 0.299515 Sep 01 14:08:02.593351 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 120/249] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:08:02 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1725 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:08:02.712499 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-4b86a2f1-4a65-4afd-920b-a7520c7efcb4 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446af6bea953401ead7e8a9c9604d8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c13f664f15145fdb9b3c4b9f8496d80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:02.722898 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-4b86a2f1-4a65-4afd-920b-a7520c7efcb4 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5" status: 200 len: 1470 microversion: 2.1 time: 0.212021 Sep 01 14:08:02.723937 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 130/250] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:02 2022] GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5 => generated 1470 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:08:02.883804 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-86c60005-2287-431a-9255-542db590beb9 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:02.884856 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-86c60005-2287-431a-9255-542db590beb9 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 846e670d-c808-44d5-be0e-9c36671fbe91] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:02.895866 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-86c60005-2287-431a-9255-542db590beb9 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:02.896728 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-86c60005-2287-431a-9255-542db590beb9 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:02.897487 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-86c60005-2287-431a-9255-542db590beb9 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:02.898758 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-86c60005-2287-431a-9255-542db590beb9 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:02.899562 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-86c60005-2287-431a-9255-542db590beb9 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:02.900293 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-86c60005-2287-431a-9255-542db590beb9 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:03.091044 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-86c60005-2287-431a-9255-542db590beb9 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:03.100678 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-86c60005-2287-431a-9255-542db590beb9 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91" status: 200 len: 1522 microversion: 2.1 time: 0.225496 Sep 01 14:08:03.101394 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 121/251] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:02 2022] GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:03.115446 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-086aa48d-d12e-42f2-82ed-a99a9dc9028b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:03.117038 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-086aa48d-d12e-42f2-82ed-a99a9dc9028b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 91814986-adf4-46cb-8edf-820106d37ecb] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:03.128442 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-086aa48d-d12e-42f2-82ed-a99a9dc9028b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:03.131710 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-086aa48d-d12e-42f2-82ed-a99a9dc9028b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:03.131710 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-086aa48d-d12e-42f2-82ed-a99a9dc9028b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:03.131710 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-086aa48d-d12e-42f2-82ed-a99a9dc9028b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:03.131710 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-086aa48d-d12e-42f2-82ed-a99a9dc9028b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:03.132426 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-086aa48d-d12e-42f2-82ed-a99a9dc9028b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:03.305379 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-086aa48d-d12e-42f2-82ed-a99a9dc9028b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:03.323766 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-086aa48d-d12e-42f2-82ed-a99a9dc9028b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb" status: 200 len: 1368 microversion: 2.1 time: 0.214256 Sep 01 14:08:03.324795 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 131/252] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:03 2022] GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb => generated 1368 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:08:03.605500 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-8150ab13-b2dc-40c9-bc17-c50d663995e4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:03.606706 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-8150ab13-b2dc-40c9-bc17-c50d663995e4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:03.613486 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8150ab13-b2dc-40c9-bc17-c50d663995e4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:03.613999 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8150ab13-b2dc-40c9-bc17-c50d663995e4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:03.614436 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8150ab13-b2dc-40c9-bc17-c50d663995e4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:03.615170 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8150ab13-b2dc-40c9-bc17-c50d663995e4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:03.615623 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8150ab13-b2dc-40c9-bc17-c50d663995e4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:03.616068 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8150ab13-b2dc-40c9-bc17-c50d663995e4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:03.747124 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-73b69db9-eb31-42d6-bf80-3aa89028f316 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:03.748138 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-73b69db9-eb31-42d6-bf80-3aa89028f316 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] [instance: 7e0f8565-bc64-439c-be78-3385624198b5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:03.754525 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-73b69db9-eb31-42d6-bf80-3aa89028f316 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:03.755129 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-73b69db9-eb31-42d6-bf80-3aa89028f316 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:03.755646 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-73b69db9-eb31-42d6-bf80-3aa89028f316 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:03.756380 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-73b69db9-eb31-42d6-bf80-3aa89028f316 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:03.756839 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-73b69db9-eb31-42d6-bf80-3aa89028f316 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:03.757265 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-73b69db9-eb31-42d6-bf80-3aa89028f316 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:03.782454 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-8150ab13-b2dc-40c9-bc17-c50d663995e4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:03.793427 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-8150ab13-b2dc-40c9-bc17-c50d663995e4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:03.795263 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-8150ab13-b2dc-40c9-bc17-c50d663995e4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:03.796509 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-8150ab13-b2dc-40c9-bc17-c50d663995e4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1725 microversion: 2.20 time: 0.195199 Sep 01 14:08:03.797182 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 122/253] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:08:03 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1725 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:08:03.803851 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-beaecd45-6fed-4ead-8dfa-529c58ca7c22 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:03.804362 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-beaecd45-6fed-4ead-8dfa-529c58ca7c22 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:03.811303 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-beaecd45-6fed-4ead-8dfa-529c58ca7c22 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:03.811871 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-beaecd45-6fed-4ead-8dfa-529c58ca7c22 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:03.812318 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-beaecd45-6fed-4ead-8dfa-529c58ca7c22 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:03.813037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-beaecd45-6fed-4ead-8dfa-529c58ca7c22 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:03.814240 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-beaecd45-6fed-4ead-8dfa-529c58ca7c22 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:03.814240 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-beaecd45-6fed-4ead-8dfa-529c58ca7c22 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:03.855867 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-beaecd45-6fed-4ead-8dfa-529c58ca7c22 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7/ips" status: 200 len: 146 microversion: 2.1 time: 0.057267 Sep 01 14:08:03.857241 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 123/254] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Sep 1 14:08:03 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7/ips => generated 146 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:08:03.933677 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-73b69db9-eb31-42d6-bf80-3aa89028f316 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446af6bea953401ead7e8a9c9604d8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c13f664f15145fdb9b3c4b9f8496d80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:03.946987 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-73b69db9-eb31-42d6-bf80-3aa89028f316 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5" status: 200 len: 1470 microversion: 2.1 time: 0.203401 Sep 01 14:08:03.948187 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 132/255] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:03 2022] GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5 => generated 1470 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:08:04.128337 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-c55cb207-e960-4ef8-b1ee-89526d9aaf52 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:04.129454 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-c55cb207-e960-4ef8-b1ee-89526d9aaf52 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 846e670d-c808-44d5-be0e-9c36671fbe91] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:04.153783 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c55cb207-e960-4ef8-b1ee-89526d9aaf52 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:04.153783 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c55cb207-e960-4ef8-b1ee-89526d9aaf52 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:04.153783 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c55cb207-e960-4ef8-b1ee-89526d9aaf52 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:04.153783 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c55cb207-e960-4ef8-b1ee-89526d9aaf52 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:04.154820 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c55cb207-e960-4ef8-b1ee-89526d9aaf52 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:04.154820 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c55cb207-e960-4ef8-b1ee-89526d9aaf52 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:04.314352 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-c55cb207-e960-4ef8-b1ee-89526d9aaf52 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:04.324304 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-c55cb207-e960-4ef8-b1ee-89526d9aaf52 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91" status: 200 len: 1522 microversion: 2.1 time: 0.203794 Sep 01 14:08:04.325212 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 124/256] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:04 2022] GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:04.355802 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-cf9034f2-a311-4c21-8ba1-7556990db9f6 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:04.356427 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-cf9034f2-a311-4c21-8ba1-7556990db9f6 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 91814986-adf4-46cb-8edf-820106d37ecb] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:04.364847 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-cf9034f2-a311-4c21-8ba1-7556990db9f6 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:04.365348 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-cf9034f2-a311-4c21-8ba1-7556990db9f6 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:04.365808 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-cf9034f2-a311-4c21-8ba1-7556990db9f6 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:04.366544 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-cf9034f2-a311-4c21-8ba1-7556990db9f6 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:04.367034 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-cf9034f2-a311-4c21-8ba1-7556990db9f6 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:04.367455 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-cf9034f2-a311-4c21-8ba1-7556990db9f6 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:04.557171 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-cf9034f2-a311-4c21-8ba1-7556990db9f6 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:04.571670 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-cf9034f2-a311-4c21-8ba1-7556990db9f6 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb" status: 200 len: 1368 microversion: 2.1 time: 0.219679 Sep 01 14:08:04.572729 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 133/257] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:04 2022] GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb => generated 1368 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:04.821768 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-e5138736-431b-474a-927e-86b54f173978 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:04.822679 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-e5138736-431b-474a-927e-86b54f173978 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:04.828448 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e5138736-431b-474a-927e-86b54f173978 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:04.828929 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e5138736-431b-474a-927e-86b54f173978 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:04.829359 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e5138736-431b-474a-927e-86b54f173978 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:04.830110 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e5138736-431b-474a-927e-86b54f173978 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:04.830558 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e5138736-431b-474a-927e-86b54f173978 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:04.831234 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e5138736-431b-474a-927e-86b54f173978 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:04.969878 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-2a69e5f0-7f77-40ee-a9d3-916e267fbcc3 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:04.970545 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-2a69e5f0-7f77-40ee-a9d3-916e267fbcc3 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] [instance: 7e0f8565-bc64-439c-be78-3385624198b5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:04.976868 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2a69e5f0-7f77-40ee-a9d3-916e267fbcc3 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:04.977418 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2a69e5f0-7f77-40ee-a9d3-916e267fbcc3 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:04.977792 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2a69e5f0-7f77-40ee-a9d3-916e267fbcc3 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:04.978533 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2a69e5f0-7f77-40ee-a9d3-916e267fbcc3 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:04.978987 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2a69e5f0-7f77-40ee-a9d3-916e267fbcc3 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:04.988164 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2a69e5f0-7f77-40ee-a9d3-916e267fbcc3 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:05.012953 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-e5138736-431b-474a-927e-86b54f173978 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:05.030185 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-e5138736-431b-474a-927e-86b54f173978 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:05.038817 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-e5138736-431b-474a-927e-86b54f173978 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:05.041757 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-e5138736-431b-474a-927e-86b54f173978 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1725 microversion: 2.20 time: 0.223687 Sep 01 14:08:05.042870 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 125/258] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:08:04 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1725 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:08:05.183187 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-2a69e5f0-7f77-40ee-a9d3-916e267fbcc3 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446af6bea953401ead7e8a9c9604d8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c13f664f15145fdb9b3c4b9f8496d80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:05.195810 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-2a69e5f0-7f77-40ee-a9d3-916e267fbcc3 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5" status: 200 len: 1470 microversion: 2.1 time: 0.229405 Sep 01 14:08:05.196840 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 134/259] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:04 2022] GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5 => generated 1470 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:05.357455 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-1b592dc8-80f9-4fe7-b176-de68f207c411 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:05.358630 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-1b592dc8-80f9-4fe7-b176-de68f207c411 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 846e670d-c808-44d5-be0e-9c36671fbe91] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:05.369888 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1b592dc8-80f9-4fe7-b176-de68f207c411 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:05.370862 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1b592dc8-80f9-4fe7-b176-de68f207c411 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:05.371653 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1b592dc8-80f9-4fe7-b176-de68f207c411 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:05.372977 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1b592dc8-80f9-4fe7-b176-de68f207c411 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:05.373844 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1b592dc8-80f9-4fe7-b176-de68f207c411 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:05.374652 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1b592dc8-80f9-4fe7-b176-de68f207c411 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:05.607471 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-cc6409c6-59fc-4095-a556-2cf83acd7b38 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:05.608193 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-cc6409c6-59fc-4095-a556-2cf83acd7b38 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 91814986-adf4-46cb-8edf-820106d37ecb] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:05.630579 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-1b592dc8-80f9-4fe7-b176-de68f207c411 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:05.637817 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-cc6409c6-59fc-4095-a556-2cf83acd7b38 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:05.639003 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-cc6409c6-59fc-4095-a556-2cf83acd7b38 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:05.640134 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-cc6409c6-59fc-4095-a556-2cf83acd7b38 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:05.641690 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-cc6409c6-59fc-4095-a556-2cf83acd7b38 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:05.642794 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-cc6409c6-59fc-4095-a556-2cf83acd7b38 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:05.643841 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-cc6409c6-59fc-4095-a556-2cf83acd7b38 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:05.657320 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-1b592dc8-80f9-4fe7-b176-de68f207c411 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91" status: 200 len: 1522 microversion: 2.1 time: 0.306604 Sep 01 14:08:05.659419 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 126/260] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:05 2022] GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91 => generated 1522 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:05.850941 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-cc6409c6-59fc-4095-a556-2cf83acd7b38 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:05.860346 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-cc6409c6-59fc-4095-a556-2cf83acd7b38 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb" status: 200 len: 1559 microversion: 2.1 time: 0.261463 Sep 01 14:08:05.860938 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 135/261] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:05 2022] GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb => generated 1559 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:05.885429 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-f2f060a9-0e89-41ec-8d3a-447f672a9a49 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:05.886007 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-f2f060a9-0e89-41ec-8d3a-447f672a9a49 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 91814986-adf4-46cb-8edf-820106d37ecb] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:05.889085 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:05.896186 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f2f060a9-0e89-41ec-8d3a-447f672a9a49 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:05.896679 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f2f060a9-0e89-41ec-8d3a-447f672a9a49 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:05.897152 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f2f060a9-0e89-41ec-8d3a-447f672a9a49 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:05.897842 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f2f060a9-0e89-41ec-8d3a-447f672a9a49 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:05.898266 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f2f060a9-0e89-41ec-8d3a-447f672a9a49 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:05.898708 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f2f060a9-0e89-41ec-8d3a-447f672a9a49 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:06.022699 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-f2f060a9-0e89-41ec-8d3a-447f672a9a49 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.143951 Sep 01 14:08:06.023411 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 127/262] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Sep 1 14:08:05 2022] GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb/os-interface => generated 285 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:08:06.092980 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-67e4deba-2bb2-4048-8862-9dd96f3d7d38 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:06.095159 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-67e4deba-2bb2-4048-8862-9dd96f3d7d38 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:06.105830 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-67e4deba-2bb2-4048-8862-9dd96f3d7d38 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:06.106752 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-67e4deba-2bb2-4048-8862-9dd96f3d7d38 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:06.107379 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-67e4deba-2bb2-4048-8862-9dd96f3d7d38 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:06.108494 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-67e4deba-2bb2-4048-8862-9dd96f3d7d38 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:06.109257 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-67e4deba-2bb2-4048-8862-9dd96f3d7d38 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:06.109860 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-67e4deba-2bb2-4048-8862-9dd96f3d7d38 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:06.234363 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-0a8de181-bd4e-47ba-a8a3-808369d0325d tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:06.235233 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-0a8de181-bd4e-47ba-a8a3-808369d0325d tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] [instance: 7e0f8565-bc64-439c-be78-3385624198b5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:06.243068 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0a8de181-bd4e-47ba-a8a3-808369d0325d tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:06.243697 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0a8de181-bd4e-47ba-a8a3-808369d0325d tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:06.244207 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0a8de181-bd4e-47ba-a8a3-808369d0325d tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:06.245006 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0a8de181-bd4e-47ba-a8a3-808369d0325d tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:06.245452 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0a8de181-bd4e-47ba-a8a3-808369d0325d tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:06.247061 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0a8de181-bd4e-47ba-a8a3-808369d0325d tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:06.660187 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-67e4deba-2bb2-4048-8862-9dd96f3d7d38 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:06.667856 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-67e4deba-2bb2-4048-8862-9dd96f3d7d38 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:06.667856 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-67e4deba-2bb2-4048-8862-9dd96f3d7d38 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:06.667856 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-67e4deba-2bb2-4048-8862-9dd96f3d7d38 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1725 microversion: 2.20 time: 0.582801 Sep 01 14:08:06.668215 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 136/263] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:08:06 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1725 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:08:06.688884 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-6be92664-4447-4beb-82cd-08a780bb9217 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:06.689641 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-6be92664-4447-4beb-82cd-08a780bb9217 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 846e670d-c808-44d5-be0e-9c36671fbe91] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:06.696905 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6be92664-4447-4beb-82cd-08a780bb9217 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:06.697471 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6be92664-4447-4beb-82cd-08a780bb9217 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:06.697964 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6be92664-4447-4beb-82cd-08a780bb9217 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:06.698737 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6be92664-4447-4beb-82cd-08a780bb9217 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:06.699230 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6be92664-4447-4beb-82cd-08a780bb9217 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:06.699659 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6be92664-4447-4beb-82cd-08a780bb9217 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:06.762580 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-0a8de181-bd4e-47ba-a8a3-808369d0325d tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446af6bea953401ead7e8a9c9604d8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c13f664f15145fdb9b3c4b9f8496d80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:06.771700 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-0a8de181-bd4e-47ba-a8a3-808369d0325d tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5" status: 200 len: 1470 microversion: 2.1 time: 0.542274 Sep 01 14:08:06.772539 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 128/264] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:06 2022] GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5 => generated 1470 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:08:07.058265 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-6be92664-4447-4beb-82cd-08a780bb9217 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:07.070481 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-6be92664-4447-4beb-82cd-08a780bb9217 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91" status: 200 len: 1522 microversion: 2.1 time: 0.385159 Sep 01 14:08:07.071471 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 137/265] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:06 2022] GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91 => generated 1522 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:07.696057 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-dd9c1b88-46e5-494a-9358-15c8ed76c6fc tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:07.697207 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-dd9c1b88-46e5-494a-9358-15c8ed76c6fc tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:07.719262 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-dd9c1b88-46e5-494a-9358-15c8ed76c6fc tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:07.720350 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-dd9c1b88-46e5-494a-9358-15c8ed76c6fc tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:07.721703 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-dd9c1b88-46e5-494a-9358-15c8ed76c6fc tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:07.722850 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-dd9c1b88-46e5-494a-9358-15c8ed76c6fc tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:07.724983 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-dd9c1b88-46e5-494a-9358-15c8ed76c6fc tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:07.725627 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-dd9c1b88-46e5-494a-9358-15c8ed76c6fc tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:07.794439 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-c12bc75c-ac46-450b-9d71-39ac75b537c1 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:07.795054 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-c12bc75c-ac46-450b-9d71-39ac75b537c1 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] [instance: 7e0f8565-bc64-439c-be78-3385624198b5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:07.804525 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c12bc75c-ac46-450b-9d71-39ac75b537c1 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:07.805091 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c12bc75c-ac46-450b-9d71-39ac75b537c1 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:07.805887 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c12bc75c-ac46-450b-9d71-39ac75b537c1 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:07.806975 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c12bc75c-ac46-450b-9d71-39ac75b537c1 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:07.807438 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c12bc75c-ac46-450b-9d71-39ac75b537c1 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:07.807867 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c12bc75c-ac46-450b-9d71-39ac75b537c1 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:07.987387 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-c12bc75c-ac46-450b-9d71-39ac75b537c1 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446af6bea953401ead7e8a9c9604d8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c13f664f15145fdb9b3c4b9f8496d80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:08.007770 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-c12bc75c-ac46-450b-9d71-39ac75b537c1 tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5" status: 200 len: 1428 microversion: 2.1 time: 0.217871 Sep 01 14:08:08.008894 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 138/266] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:07 2022] GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5 => generated 1428 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:08:08.023510 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [req-524a06df-c8d2-4d51-9e0b-aee131bd6ee8 req-39d6595f-a6da-4c55-b936-783854cc6ef1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e0f8565-bc64-439c-be78-3385624198b5", "name": "network-vif-deleted", "tag": "567f782a-6b5e-4df4-9763-c0f2c4ed650f"}]} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:08:08.037431 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-524a06df-c8d2-4d51-9e0b-aee131bd6ee8 req-39d6595f-a6da-4c55-b936-783854cc6ef1 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:08.038161 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-524a06df-c8d2-4d51-9e0b-aee131bd6ee8 req-39d6595f-a6da-4c55-b936-783854cc6ef1 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:08.042993 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-524a06df-c8d2-4d51-9e0b-aee131bd6ee8 req-39d6595f-a6da-4c55-b936-783854cc6ef1 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:08.052063 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.compute.server_external_events [req-524a06df-c8d2-4d51-9e0b-aee131bd6ee8 req-39d6595f-a6da-4c55-b936-783854cc6ef1 service nova] Creating event network-vif-deleted:567f782a-6b5e-4df4-9763-c0f2c4ed650f for instance 7e0f8565-bc64-439c-be78-3385624198b5 on hv-cinder-85221 Sep 01 14:08:08.057308 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [req-524a06df-c8d2-4d51-9e0b-aee131bd6ee8 req-39d6595f-a6da-4c55-b936-783854cc6ef1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046603 Sep 01 14:08:08.058292 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 139/267] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:08:08.100517 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-3c709a6a-bed3-4977-a896-ada14179989a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:08.102135 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-3c709a6a-bed3-4977-a896-ada14179989a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 846e670d-c808-44d5-be0e-9c36671fbe91] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:08.109350 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3c709a6a-bed3-4977-a896-ada14179989a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:08.109854 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3c709a6a-bed3-4977-a896-ada14179989a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:08.110338 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3c709a6a-bed3-4977-a896-ada14179989a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:08.111065 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3c709a6a-bed3-4977-a896-ada14179989a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:08.111593 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3c709a6a-bed3-4977-a896-ada14179989a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:08.112211 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3c709a6a-bed3-4977-a896-ada14179989a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:08.139733 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-dd9c1b88-46e5-494a-9358-15c8ed76c6fc tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:08.152047 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-dd9c1b88-46e5-494a-9358-15c8ed76c6fc tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:08.153957 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-dd9c1b88-46e5-494a-9358-15c8ed76c6fc tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:08.155349 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-dd9c1b88-46e5-494a-9358-15c8ed76c6fc tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1725 microversion: 2.20 time: 0.467839 Sep 01 14:08:08.172388 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 129/268] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:08:07 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1725 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:08:08.366105 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-3c709a6a-bed3-4977-a896-ada14179989a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:08.376702 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-3c709a6a-bed3-4977-a896-ada14179989a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91" status: 200 len: 1522 microversion: 2.1 time: 0.282004 Sep 01 14:08:08.377819 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 140/269] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:08 2022] GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91 => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:08:09.037265 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-56922788-7ac0-46d7-ba3f-c96440c9a97d tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:09.039649 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-56922788-7ac0-46d7-ba3f-c96440c9a97d tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] [instance: 7e0f8565-bc64-439c-be78-3385624198b5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:09.063532 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-56922788-7ac0-46d7-ba3f-c96440c9a97d tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:09.067069 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-56922788-7ac0-46d7-ba3f-c96440c9a97d tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:09.068456 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-56922788-7ac0-46d7-ba3f-c96440c9a97d tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:09.069993 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-56922788-7ac0-46d7-ba3f-c96440c9a97d tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:09.071413 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-56922788-7ac0-46d7-ba3f-c96440c9a97d tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:09.073034 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-56922788-7ac0-46d7-ba3f-c96440c9a97d tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:09.149995 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-56922788-7ac0-46d7-ba3f-c96440c9a97d tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:09.150784 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-56922788-7ac0-46d7-ba3f-c96440c9a97d tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:09.151321 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-56922788-7ac0-46d7-ba3f-c96440c9a97d tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:09.151787 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.objects.instance [None req-56922788-7ac0-46d7-ba3f-c96440c9a97d tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lazy-loading 'fault' on Instance uuid 7e0f8565-bc64-439c-be78-3385624198b5 {{(pid=121339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:08:09.181877 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-8d2cdcdd-4ff1-4bad-96a6-42706dc812ee tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:09.182703 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-8d2cdcdd-4ff1-4bad-96a6-42706dc812ee tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:09.197288 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8d2cdcdd-4ff1-4bad-96a6-42706dc812ee tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:09.199744 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8d2cdcdd-4ff1-4bad-96a6-42706dc812ee tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:09.200540 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8d2cdcdd-4ff1-4bad-96a6-42706dc812ee tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:09.208035 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8d2cdcdd-4ff1-4bad-96a6-42706dc812ee tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:09.208035 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8d2cdcdd-4ff1-4bad-96a6-42706dc812ee tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:09.208035 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8d2cdcdd-4ff1-4bad-96a6-42706dc812ee tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:09.241517 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-56922788-7ac0-46d7-ba3f-c96440c9a97d tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '446af6bea953401ead7e8a9c9604d8d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c13f664f15145fdb9b3c4b9f8496d80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:09.251000 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-56922788-7ac0-46d7-ba3f-c96440c9a97d tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5" status: 200 len: 1304 microversion: 2.1 time: 0.223232 Sep 01 14:08:09.259586 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 130/270] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:09 2022] GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5 => generated 1304 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:09.405398 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-0587e525-e8c3-4772-91cd-1f875e087902 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:09.407341 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-0587e525-e8c3-4772-91cd-1f875e087902 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 846e670d-c808-44d5-be0e-9c36671fbe91] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:09.420548 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0587e525-e8c3-4772-91cd-1f875e087902 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:09.422100 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0587e525-e8c3-4772-91cd-1f875e087902 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:09.423236 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0587e525-e8c3-4772-91cd-1f875e087902 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:09.425146 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0587e525-e8c3-4772-91cd-1f875e087902 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:09.426304 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0587e525-e8c3-4772-91cd-1f875e087902 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:09.427748 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0587e525-e8c3-4772-91cd-1f875e087902 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:09.434200 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-8d2cdcdd-4ff1-4bad-96a6-42706dc812ee tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:09.452489 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-8d2cdcdd-4ff1-4bad-96a6-42706dc812ee tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:09.466085 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-8d2cdcdd-4ff1-4bad-96a6-42706dc812ee tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:09.466085 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-8d2cdcdd-4ff1-4bad-96a6-42706dc812ee tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1725 microversion: 2.20 time: 0.282066 Sep 01 14:08:09.466085 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 141/271] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:08:09 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1725 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:08:09.708158 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-0587e525-e8c3-4772-91cd-1f875e087902 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:09.719822 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-0587e525-e8c3-4772-91cd-1f875e087902 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91" status: 200 len: 1522 microversion: 2.1 time: 0.322890 Sep 01 14:08:09.739199 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 131/272] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:09 2022] GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91 => generated 1522 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:08:10.104526 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [req-0398ace0-b152-46e2-b7d3-239f36ab97c2 req-0d72f994-ef0f-4776-9549-442bae2bf814 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91814986-adf4-46cb-8edf-820106d37ecb", "tag": "e0564e10-4a1c-482b-8355-e8813807b5bd"}]} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:08:10.127885 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-0398ace0-b152-46e2-b7d3-239f36ab97c2 req-0d72f994-ef0f-4776-9549-442bae2bf814 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:10.128873 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-0398ace0-b152-46e2-b7d3-239f36ab97c2 req-0d72f994-ef0f-4776-9549-442bae2bf814 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:10.129768 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-0398ace0-b152-46e2-b7d3-239f36ab97c2 req-0d72f994-ef0f-4776-9549-442bae2bf814 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:10.144946 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-e8f8aa69-8a30-43bd-9986-c8ad1bfa29d4 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8eb71d4b-9a62-40ff-a96f-cdb5eb7624e5"}} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:08:10.146430 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-e8f8aa69-8a30-43bd-9986-c8ad1bfa29d4 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:10.156403 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.compute.server_external_events [req-0398ace0-b152-46e2-b7d3-239f36ab97c2 req-0d72f994-ef0f-4776-9549-442bae2bf814 service nova] Creating event network-changed:e0564e10-4a1c-482b-8355-e8813807b5bd for instance 91814986-adf4-46cb-8edf-820106d37ecb on hv-cinder-85221 Sep 01 14:08:10.166782 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [req-0398ace0-b152-46e2-b7d3-239f36ab97c2 req-0d72f994-ef0f-4776-9549-442bae2bf814 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071845 Sep 01 14:08:10.168290 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e8f8aa69-8a30-43bd-9986-c8ad1bfa29d4 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:10.168809 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 142/273] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:08:10.169950 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e8f8aa69-8a30-43bd-9986-c8ad1bfa29d4 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:10.170371 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e8f8aa69-8a30-43bd-9986-c8ad1bfa29d4 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:10.174801 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e8f8aa69-8a30-43bd-9986-c8ad1bfa29d4 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:10.175610 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e8f8aa69-8a30-43bd-9986-c8ad1bfa29d4 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:10.177503 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e8f8aa69-8a30-43bd-9986-c8ad1bfa29d4 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:10.192945 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell1:SELECT=100 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:10.287469 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-4433b1a3-bfc4-4af9-86ca-81d90bcce8eb tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:10.289052 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-4433b1a3-bfc4-4af9-86ca-81d90bcce8eb tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] [instance: 7e0f8565-bc64-439c-be78-3385624198b5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:10.297242 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4433b1a3-bfc4-4af9-86ca-81d90bcce8eb tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:10.298142 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4433b1a3-bfc4-4af9-86ca-81d90bcce8eb tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:10.298828 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4433b1a3-bfc4-4af9-86ca-81d90bcce8eb tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:10.301949 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4433b1a3-bfc4-4af9-86ca-81d90bcce8eb tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:10.302744 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4433b1a3-bfc4-4af9-86ca-81d90bcce8eb tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:10.303432 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4433b1a3-bfc4-4af9-86ca-81d90bcce8eb tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:10.320490 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.wsgi [None req-4433b1a3-bfc4-4af9-86ca-81d90bcce8eb tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] HTTP exception thrown: Instance 7e0f8565-bc64-439c-be78-3385624198b5 could not be found. Sep 01 14:08:10.322656 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-4433b1a3-bfc4-4af9-86ca-81d90bcce8eb tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Request method failure captured: Sep 01 14:08:10.322656 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: request: GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5 HTTP/1.1 Sep 01 14:08:10.322656 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept: application/json Sep 01 14:08:10.322656 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept-Encoding: identity Sep 01 14:08:10.322656 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Connection: close Sep 01 14:08:10.322656 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Length: 0 Sep 01 14:08:10.322656 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Type: application/json Sep 01 14:08:10.322656 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Host: 10.222.0.25 Sep 01 14:08:10.322656 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Openstack-System-Scope: None Sep 01 14:08:10.322656 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: User-Agent: python-urllib3/1.26.12 Sep 01 14:08:10.322656 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Auth-Token: gAAAAABjELydRhj3iUpek7jtW9TqzJCpn7-_JepAU7jUMNAGEA4ywjs3ibdQ5UWawtLBzLm2QlZwml-9TWSwVKlWZT4uaYPWfVsa9mm7LCDEsSl2R1zUoPttUayprW2ahOCgO-LGHtL4CbT4WIb0mi8uW1dO_zyOEqWazixKSqRuGJVbxka8Md4 Sep 01 14:08:10.322656 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Id: None Sep 01 14:08:10.322656 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Name: None Sep 01 14:08:10.322656 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Identity-Status: Confirmed Sep 01 14:08:10.322656 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Is-Admin-Project: True Sep 01 14:08:10.322656 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Id: default Sep 01 14:08:10.322656 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Name: Default Sep 01 14:08:10.322656 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Id: 1c13f664f15145fdb9b3c4b9f8496d80 Sep 01 14:08:10.322656 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Name: tempest-VolumesNegativeTest-1610413475 Sep 01 14:08:10.322656 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Role: member,reader Sep 01 14:08:10.322656 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Roles: member,reader Sep 01 14:08:10.323930 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1c13f664f15145fdb9b3c4b9f8496d80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/1c13f664f15145fdb9b3c4b9f8496d80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/1c13f664f15145fdb9b3c4b9f8496d80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_1c13f664f15145fdb9b3c4b9f8496d80"}]}] Sep 01 14:08:10.323930 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant: tempest-VolumesNegativeTest-1610413475 Sep 01 14:08:10.323930 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Id: 1c13f664f15145fdb9b3c4b9f8496d80 Sep 01 14:08:10.323930 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Name: tempest-VolumesNegativeTest-1610413475 Sep 01 14:08:10.323930 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User: tempest-VolumesNegativeTest-1610413475-project Sep 01 14:08:10.323930 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Id: default Sep 01 14:08:10.323930 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Name: Default Sep 01 14:08:10.323930 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Id: 446af6bea953401ead7e8a9c9604d8d0 Sep 01 14:08:10.323930 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Name: tempest-VolumesNegativeTest-1610413475-project Sep 01 14:08:10.323930 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: method: > Sep 01 14:08:10.323930 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: exception: Instance 7e0f8565-bc64-439c-be78-3385624198b5 could not be found. Sep 01 14:08:10.323930 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: action_args: {'id': '7e0f8565-bc64-439c-be78-3385624198b5'} Sep 01 14:08:10.324653 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:08:10.324653 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:10.324653 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:08:10.324653 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:08:10.324653 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:08:10.324653 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:08:10.324653 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:08:10.324653 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:08:10.324653 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:08:10.324653 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:08:10.324653 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e0f8565-bc64-439c-be78-3385624198b5 could not be found. Sep 01 14:08:10.324653 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:08:10.324653 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:10.324653 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:08:10.324653 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:10.324653 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:10.324653 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:10.324653 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:08:10.324653 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:08:10.324653 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:08:10.325840 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:08:10.325840 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:08:10.325840 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:08:10.325840 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:08:10.325840 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:08:10.325840 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:08:10.325840 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:08:10.325840 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e0f8565-bc64-439c-be78-3385624198b5 could not be found. Sep 01 14:08:10.325840 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:08:10.325840 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:10.325840 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:08:10.325840 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:10.325840 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:10.325840 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:10.325840 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:08:10.325840 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:08:10.325840 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e0f8565-bc64-439c-be78-3385624198b5 could not be found. Sep 01 14:08:10.325840 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:08:10.327599 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-4433b1a3-bfc4-4af9-86ca-81d90bcce8eb tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] Returning 404 to user: Instance 7e0f8565-bc64-439c-be78-3385624198b5 could not be found. {{(pid=121340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:08:10.328415 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-4433b1a3-bfc4-4af9-86ca-81d90bcce8eb tempest-VolumesNegativeTest-1610413475 tempest-VolumesNegativeTest-1610413475-project] 10.222.0.25 "GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5" status: 404 len: 111 microversion: 2.1 time: 0.050812 Sep 01 14:08:10.333700 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 143/274] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:10 2022] GET /compute/v2.1/servers/7e0f8565-bc64-439c-be78-3385624198b5 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 14:08:10.496407 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-182a7900-88f3-444e-9d5b-a1486ea420c6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:10.497207 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-182a7900-88f3-444e-9d5b-a1486ea420c6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:10.515015 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-182a7900-88f3-444e-9d5b-a1486ea420c6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:10.515735 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-182a7900-88f3-444e-9d5b-a1486ea420c6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:10.519925 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-182a7900-88f3-444e-9d5b-a1486ea420c6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:10.522432 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-182a7900-88f3-444e-9d5b-a1486ea420c6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:10.523308 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-182a7900-88f3-444e-9d5b-a1486ea420c6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:10.524076 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-182a7900-88f3-444e-9d5b-a1486ea420c6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:10.911260 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-182a7900-88f3-444e-9d5b-a1486ea420c6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:10.925239 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-182a7900-88f3-444e-9d5b-a1486ea420c6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:10.926967 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-182a7900-88f3-444e-9d5b-a1486ea420c6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:10.931654 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-182a7900-88f3-444e-9d5b-a1486ea420c6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1725 microversion: 2.20 time: 0.441410 Sep 01 14:08:10.931654 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 144/275] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:08:10 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1725 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:08:10.948021 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-a7ede4f9-0105-4ea7-b285-cd80edfd0be1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:10.950603 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-a7ede4f9-0105-4ea7-b285-cd80edfd0be1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 846e670d-c808-44d5-be0e-9c36671fbe91] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:10.961131 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a7ede4f9-0105-4ea7-b285-cd80edfd0be1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:10.962239 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a7ede4f9-0105-4ea7-b285-cd80edfd0be1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:10.962858 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a7ede4f9-0105-4ea7-b285-cd80edfd0be1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:10.964255 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a7ede4f9-0105-4ea7-b285-cd80edfd0be1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:10.965154 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a7ede4f9-0105-4ea7-b285-cd80edfd0be1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:10.966438 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a7ede4f9-0105-4ea7-b285-cd80edfd0be1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:11.238785 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-a7ede4f9-0105-4ea7-b285-cd80edfd0be1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:11.249087 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-a7ede4f9-0105-4ea7-b285-cd80edfd0be1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91" status: 200 len: 1522 microversion: 2.1 time: 0.317426 Sep 01 14:08:11.250682 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 145/276] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:10 2022] GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91 => generated 1522 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:11.555154 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-e8f8aa69-8a30-43bd-9986-c8ad1bfa29d4 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "POST /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.416444 Sep 01 14:08:11.556949 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 132/277] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Sep 1 14:08:10 2022] POST /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7/os-volume_attachments => generated 194 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:08:11.954881 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-2c55db7b-1bfb-4130-8ec9-b71191e8c907 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:11.959813 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-2c55db7b-1bfb-4130-8ec9-b71191e8c907 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:11.964194 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2c55db7b-1bfb-4130-8ec9-b71191e8c907 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:11.964813 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2c55db7b-1bfb-4130-8ec9-b71191e8c907 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:11.965371 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2c55db7b-1bfb-4130-8ec9-b71191e8c907 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:11.966636 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2c55db7b-1bfb-4130-8ec9-b71191e8c907 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:11.967133 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2c55db7b-1bfb-4130-8ec9-b71191e8c907 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:11.967914 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2c55db7b-1bfb-4130-8ec9-b71191e8c907 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:11.974655 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:12.154299 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-2c55db7b-1bfb-4130-8ec9-b71191e8c907 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:12.164370 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-2c55db7b-1bfb-4130-8ec9-b71191e8c907 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:12.165860 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-2c55db7b-1bfb-4130-8ec9-b71191e8c907 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:12.167125 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-2c55db7b-1bfb-4130-8ec9-b71191e8c907 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1725 microversion: 2.20 time: 0.217937 Sep 01 14:08:12.182225 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 146/278] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:08:11 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:08:12.271949 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-ec5477c6-ee4c-4525-baf4-7d5a607decb2 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:12.272652 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-ec5477c6-ee4c-4525-baf4-7d5a607decb2 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 846e670d-c808-44d5-be0e-9c36671fbe91] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:12.279488 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ec5477c6-ee4c-4525-baf4-7d5a607decb2 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:12.280094 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ec5477c6-ee4c-4525-baf4-7d5a607decb2 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:12.280571 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ec5477c6-ee4c-4525-baf4-7d5a607decb2 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:12.281317 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ec5477c6-ee4c-4525-baf4-7d5a607decb2 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:12.281809 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ec5477c6-ee4c-4525-baf4-7d5a607decb2 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:12.282367 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ec5477c6-ee4c-4525-baf4-7d5a607decb2 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:12.494998 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-ec5477c6-ee4c-4525-baf4-7d5a607decb2 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:12.505059 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-ec5477c6-ee4c-4525-baf4-7d5a607decb2 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91" status: 200 len: 1522 microversion: 2.1 time: 0.237346 Sep 01 14:08:12.506278 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 133/279] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:12 2022] GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:13.198789 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-4bfa41e0-31ed-4582-83e2-4381ff12ad72 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:13.200802 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-4bfa41e0-31ed-4582-83e2-4381ff12ad72 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:13.214494 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4bfa41e0-31ed-4582-83e2-4381ff12ad72 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:13.215285 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4bfa41e0-31ed-4582-83e2-4381ff12ad72 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:13.216302 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4bfa41e0-31ed-4582-83e2-4381ff12ad72 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:13.217785 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4bfa41e0-31ed-4582-83e2-4381ff12ad72 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:13.218897 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4bfa41e0-31ed-4582-83e2-4381ff12ad72 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:13.219860 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4bfa41e0-31ed-4582-83e2-4381ff12ad72 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:13.508655 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-4bfa41e0-31ed-4582-83e2-4381ff12ad72 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:13.519579 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-4bfa41e0-31ed-4582-83e2-4381ff12ad72 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:13.521392 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-4bfa41e0-31ed-4582-83e2-4381ff12ad72 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:13.522848 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-4bfa41e0-31ed-4582-83e2-4381ff12ad72 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1725 microversion: 2.20 time: 0.334056 Sep 01 14:08:13.523547 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 147/280] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:08:13 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1725 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:08:13.537694 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-1269601a-fa0e-4dab-bff8-34e552baae53 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:13.538620 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-1269601a-fa0e-4dab-bff8-34e552baae53 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 846e670d-c808-44d5-be0e-9c36671fbe91] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:13.558957 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1269601a-fa0e-4dab-bff8-34e552baae53 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:13.559763 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1269601a-fa0e-4dab-bff8-34e552baae53 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:13.560588 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1269601a-fa0e-4dab-bff8-34e552baae53 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:13.562582 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1269601a-fa0e-4dab-bff8-34e552baae53 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:13.563663 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1269601a-fa0e-4dab-bff8-34e552baae53 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:13.566133 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1269601a-fa0e-4dab-bff8-34e552baae53 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:13.778406 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-1269601a-fa0e-4dab-bff8-34e552baae53 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:13.787522 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-1269601a-fa0e-4dab-bff8-34e552baae53 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91" status: 200 len: 1522 microversion: 2.1 time: 0.258243 Sep 01 14:08:13.788575 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 134/281] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:13 2022] GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91 => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:08:14.553821 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-d249581c-8a0a-4866-bc6d-065764bd02ce tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:14.556127 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-d249581c-8a0a-4866-bc6d-065764bd02ce tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:14.569978 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d249581c-8a0a-4866-bc6d-065764bd02ce tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:14.570868 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d249581c-8a0a-4866-bc6d-065764bd02ce tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:14.571699 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d249581c-8a0a-4866-bc6d-065764bd02ce tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:14.574155 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d249581c-8a0a-4866-bc6d-065764bd02ce tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:14.574779 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d249581c-8a0a-4866-bc6d-065764bd02ce tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:14.575333 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d249581c-8a0a-4866-bc6d-065764bd02ce tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:14.788325 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-d249581c-8a0a-4866-bc6d-065764bd02ce tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:14.797239 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-d249581c-8a0a-4866-bc6d-065764bd02ce tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:14.799723 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-d249581c-8a0a-4866-bc6d-065764bd02ce tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:14.800972 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-d249581c-8a0a-4866-bc6d-065764bd02ce tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1725 microversion: 2.20 time: 0.255762 Sep 01 14:08:14.801539 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 148/282] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:08:14 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1725 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:08:14.820926 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-68bccf51-e6bc-48e6-afd6-4c67ade17697 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:14.821537 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-68bccf51-e6bc-48e6-afd6-4c67ade17697 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 846e670d-c808-44d5-be0e-9c36671fbe91] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:14.833301 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-68bccf51-e6bc-48e6-afd6-4c67ade17697 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:14.833799 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-68bccf51-e6bc-48e6-afd6-4c67ade17697 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:14.834916 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-68bccf51-e6bc-48e6-afd6-4c67ade17697 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:14.836755 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-68bccf51-e6bc-48e6-afd6-4c67ade17697 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:14.838366 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-68bccf51-e6bc-48e6-afd6-4c67ade17697 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:14.839290 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-68bccf51-e6bc-48e6-afd6-4c67ade17697 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:15.055051 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-68bccf51-e6bc-48e6-afd6-4c67ade17697 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:15.064174 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-68bccf51-e6bc-48e6-afd6-4c67ade17697 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91" status: 200 len: 1522 microversion: 2.1 time: 0.247529 Sep 01 14:08:15.065026 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 135/283] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:14 2022] GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:15.827579 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-b4934fe7-ff2b-46d3-b51b-3df0a3cf88fa tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:15.828665 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-b4934fe7-ff2b-46d3-b51b-3df0a3cf88fa tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:15.839806 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b4934fe7-ff2b-46d3-b51b-3df0a3cf88fa tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:15.839806 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b4934fe7-ff2b-46d3-b51b-3df0a3cf88fa tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:15.839806 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b4934fe7-ff2b-46d3-b51b-3df0a3cf88fa tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:15.840388 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b4934fe7-ff2b-46d3-b51b-3df0a3cf88fa tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:15.840475 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b4934fe7-ff2b-46d3-b51b-3df0a3cf88fa tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:15.840898 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b4934fe7-ff2b-46d3-b51b-3df0a3cf88fa tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:16.004858 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-b4934fe7-ff2b-46d3-b51b-3df0a3cf88fa tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:16.018176 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-b4934fe7-ff2b-46d3-b51b-3df0a3cf88fa tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:16.020383 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-b4934fe7-ff2b-46d3-b51b-3df0a3cf88fa tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:16.022374 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-b4934fe7-ff2b-46d3-b51b-3df0a3cf88fa tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1725 microversion: 2.20 time: 0.201111 Sep 01 14:08:16.023480 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 149/284] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:08:15 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1725 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:08:16.094572 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-afa31df9-c125-490c-8948-161d11db0de6 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:16.095662 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-afa31df9-c125-490c-8948-161d11db0de6 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 846e670d-c808-44d5-be0e-9c36671fbe91] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:16.112126 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-afa31df9-c125-490c-8948-161d11db0de6 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:16.113000 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-afa31df9-c125-490c-8948-161d11db0de6 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:16.114141 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-afa31df9-c125-490c-8948-161d11db0de6 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:16.115422 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-afa31df9-c125-490c-8948-161d11db0de6 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:16.120038 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-afa31df9-c125-490c-8948-161d11db0de6 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:16.120038 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-afa31df9-c125-490c-8948-161d11db0de6 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:16.492334 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-afa31df9-c125-490c-8948-161d11db0de6 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:16.507767 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-afa31df9-c125-490c-8948-161d11db0de6 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91" status: 200 len: 1502 microversion: 2.1 time: 0.418040 Sep 01 14:08:16.509272 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 136/285] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:16 2022] GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91 => generated 1502 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:08:16.533049 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-aeb51336-228c-40c1-acc8-ca69362e3cf6 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce90ccf8-763a-4eb4-bc55-82364ea8edf8"}} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:08:16.541815 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-aeb51336-228c-40c1-acc8-ca69362e3cf6 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 846e670d-c808-44d5-be0e-9c36671fbe91] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:16.559257 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-aeb51336-228c-40c1-acc8-ca69362e3cf6 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:16.559257 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-aeb51336-228c-40c1-acc8-ca69362e3cf6 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:16.559409 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-aeb51336-228c-40c1-acc8-ca69362e3cf6 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:16.560028 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-aeb51336-228c-40c1-acc8-ca69362e3cf6 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:16.560483 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-aeb51336-228c-40c1-acc8-ca69362e3cf6 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:16.560891 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-aeb51336-228c-40c1-acc8-ca69362e3cf6 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:16.613309 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.wsgi [None req-aeb51336-228c-40c1-acc8-ca69362e3cf6 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] HTTP exception thrown: Cannot 'attach_volume' instance 846e670d-c808-44d5-be0e-9c36671fbe91 while it is in vm_state rescued Sep 01 14:08:16.617785 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-aeb51336-228c-40c1-acc8-ca69362e3cf6 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Request method failure captured: Sep 01 14:08:16.617785 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: request: POST /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91/os-volume_attachments HTTP/1.1 Sep 01 14:08:16.617785 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept: application/json Sep 01 14:08:16.617785 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept-Encoding: identity Sep 01 14:08:16.617785 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Connection: close Sep 01 14:08:16.617785 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Length: 74 Sep 01 14:08:16.617785 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Type: application/json Sep 01 14:08:16.617785 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Host: 10.222.0.25 Sep 01 14:08:16.617785 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Openstack-System-Scope: None Sep 01 14:08:16.617785 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: User-Agent: python-urllib3/1.26.12 Sep 01 14:08:16.617785 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Auth-Token: gAAAAABjELxNSn4EzJ0vI_pvxfL9hGqrffkkfs5u7M-T-ZaLF_wq7SVdY_htuaEWbVmy9Lvl0CF1D_LFwelOxAi92tddj_IJnalwYlx7xPOW4n4bgS9gHt9DKo6_AsO5Qtp2tceRb-kv99jz0XhNuJDrlowBE-mVHlpHgp4Gba56rctae9kot8o Sep 01 14:08:16.617785 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Id: None Sep 01 14:08:16.617785 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Name: None Sep 01 14:08:16.617785 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Identity-Status: Confirmed Sep 01 14:08:16.617785 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Is-Admin-Project: True Sep 01 14:08:16.617785 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Id: default Sep 01 14:08:16.617785 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Name: Default Sep 01 14:08:16.617785 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Id: 36049d2090b84443a3bf3bf00558379e Sep 01 14:08:16.617785 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-697169282 Sep 01 14:08:16.617785 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Role: member,reader Sep 01 14:08:16.617785 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Roles: member,reader Sep 01 14:08:16.620723 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/36049d2090b84443a3bf3bf00558379e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/36049d2090b84443a3bf3bf00558379e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/36049d2090b84443a3bf3bf00558379e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_36049d2090b84443a3bf3bf00558379e"}]}] Sep 01 14:08:16.620723 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant: tempest-ServerRescueNegativeTestJSON-697169282 Sep 01 14:08:16.620723 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Id: 36049d2090b84443a3bf3bf00558379e Sep 01 14:08:16.620723 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-697169282 Sep 01 14:08:16.620723 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User: tempest-ServerRescueNegativeTestJSON-697169282-project Sep 01 14:08:16.620723 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Id: default Sep 01 14:08:16.620723 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Name: Default Sep 01 14:08:16.620723 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Id: 7562a0429fdf42948174b517b211884f Sep 01 14:08:16.620723 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Name: tempest-ServerRescueNegativeTestJSON-697169282-project Sep 01 14:08:16.620723 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Sep 01 14:08:16.620723 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: {"volumeAttachment": {"volumeId": "ce90ccf8-763a-4eb4-bc55-82364ea8edf8"}} Sep 01 14:08:16.620723 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: method: > Sep 01 14:08:16.622305 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: exception: Cannot 'attach_volume' instance 846e670d-c808-44d5-be0e-9c36671fbe91 while it is in vm_state rescued Sep 01 14:08:16.622305 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: action_args: {'server_id': '846e670d-c808-44d5-be0e-9c36671fbe91', 'body': {'volumeAttachment': {'volumeId': 'ce90ccf8-763a-4eb4-bc55-82364ea8edf8'}}} Sep 01 14:08:16.622305 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:08:16.622305 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:16.622305 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 14:08:16.622305 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 14:08:16.622305 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 14:08:16.622305 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 14:08:16.622305 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 01 14:08:16.622305 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 01 14:08:16.622305 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 846e670d-c808-44d5-be0e-9c36671fbe91 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 01 14:08:16.622305 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:08:16.622305 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:16.622305 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:08:16.622305 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:16.622305 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:16.622305 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:16.622305 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:08:16.622305 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:08:16.628801 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:08:16.628801 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:08:16.628801 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 14:08:16.628801 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 14:08:16.628801 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 14:08:16.628801 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 14:08:16.628801 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 14:08:16.628801 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 14:08:16.628801 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 01 14:08:16.628801 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 01 14:08:16.628801 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 01 14:08:16.628801 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 01 14:08:16.628801 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 846e670d-c808-44d5-be0e-9c36671fbe91 while it is in vm_state rescued Sep 01 14:08:16.628801 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:08:16.628801 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:16.628801 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:08:16.628801 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:16.628801 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:16.628801 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:16.631611 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:08:16.631611 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:08:16.631611 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 846e670d-c808-44d5-be0e-9c36671fbe91 while it is in vm_state rescued Sep 01 14:08:16.631611 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:08:16.631611 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-aeb51336-228c-40c1-acc8-ca69362e3cf6 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Returning 409 to user: Cannot 'attach_volume' instance 846e670d-c808-44d5-be0e-9c36671fbe91 while it is in vm_state rescued {{(pid=121340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:08:16.631611 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-aeb51336-228c-40c1-acc8-ca69362e3cf6 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "POST /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.099746 Sep 01 14:08:16.634790 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 150/286] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Sep 1 14:08:16 2022] POST /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91/os-volume_attachments => generated 152 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 01 14:08:16.645153 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-c807165e-4fab-43f3-8776-b768dae9143e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:08:16.646296 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-c807165e-4fab-43f3-8776-b768dae9143e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 846e670d-c808-44d5-be0e-9c36671fbe91] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:16.660402 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c807165e-4fab-43f3-8776-b768dae9143e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:16.662203 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c807165e-4fab-43f3-8776-b768dae9143e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:16.664886 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c807165e-4fab-43f3-8776-b768dae9143e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:16.666310 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c807165e-4fab-43f3-8776-b768dae9143e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:16.667196 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c807165e-4fab-43f3-8776-b768dae9143e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:16.668021 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c807165e-4fab-43f3-8776-b768dae9143e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:17.056014 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-c807165e-4fab-43f3-8776-b768dae9143e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "POST /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91/action" status: 202 len: 0 microversion: 2.1 time: 0.416491 Sep 01 14:08:17.057299 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 137/287] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Sep 1 14:08:16 2022] POST /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91/action => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 14:08:17.061494 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-dc3fe782-1ee7-4124-8a66-0adb5959a775 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:17.062760 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-dc3fe782-1ee7-4124-8a66-0adb5959a775 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:17.075363 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-dc3fe782-1ee7-4124-8a66-0adb5959a775 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:17.076583 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-dc3fe782-1ee7-4124-8a66-0adb5959a775 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:17.077661 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-dc3fe782-1ee7-4124-8a66-0adb5959a775 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:17.079368 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-dc3fe782-1ee7-4124-8a66-0adb5959a775 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:17.081446 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-dc3fe782-1ee7-4124-8a66-0adb5959a775 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:17.082506 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-dc3fe782-1ee7-4124-8a66-0adb5959a775 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:17.087561 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-598e5405-dc67-4a71-899e-f436ebd5ad6b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:17.091521 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-598e5405-dc67-4a71-899e-f436ebd5ad6b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 846e670d-c808-44d5-be0e-9c36671fbe91] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:17.111154 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-598e5405-dc67-4a71-899e-f436ebd5ad6b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:17.113356 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-598e5405-dc67-4a71-899e-f436ebd5ad6b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:17.115057 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-598e5405-dc67-4a71-899e-f436ebd5ad6b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:17.116961 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-598e5405-dc67-4a71-899e-f436ebd5ad6b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:17.118043 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-598e5405-dc67-4a71-899e-f436ebd5ad6b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:17.119021 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-598e5405-dc67-4a71-899e-f436ebd5ad6b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:17.373807 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-dc3fe782-1ee7-4124-8a66-0adb5959a775 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:17.383640 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-598e5405-dc67-4a71-899e-f436ebd5ad6b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:17.384666 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-dc3fe782-1ee7-4124-8a66-0adb5959a775 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:17.387214 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-dc3fe782-1ee7-4124-8a66-0adb5959a775 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:17.389947 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-dc3fe782-1ee7-4124-8a66-0adb5959a775 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1746 microversion: 2.20 time: 0.336428 Sep 01 14:08:17.391306 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 151/288] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:08:17 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1746 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:08:17.404258 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-598e5405-dc67-4a71-899e-f436ebd5ad6b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91" status: 200 len: 1510 microversion: 2.1 time: 0.335150 Sep 01 14:08:17.405656 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 138/289] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:17 2022] GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91 => generated 1510 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:18.417418 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-75b371ad-fc20-4bbe-82a0-fc7ac4a7ee76 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:18.418299 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-75b371ad-fc20-4bbe-82a0-fc7ac4a7ee76 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:18.430000 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-d217e0bd-95f9-4ca4-8cde-cf530ebd7d14 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:18.430793 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-d217e0bd-95f9-4ca4-8cde-cf530ebd7d14 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 846e670d-c808-44d5-be0e-9c36671fbe91] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:18.449660 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d217e0bd-95f9-4ca4-8cde-cf530ebd7d14 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:18.449809 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-75b371ad-fc20-4bbe-82a0-fc7ac4a7ee76 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:18.449941 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d217e0bd-95f9-4ca4-8cde-cf530ebd7d14 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:18.450202 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-75b371ad-fc20-4bbe-82a0-fc7ac4a7ee76 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:18.450706 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d217e0bd-95f9-4ca4-8cde-cf530ebd7d14 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:18.451465 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d217e0bd-95f9-4ca4-8cde-cf530ebd7d14 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:18.451935 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d217e0bd-95f9-4ca4-8cde-cf530ebd7d14 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:18.452996 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-75b371ad-fc20-4bbe-82a0-fc7ac4a7ee76 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:18.454014 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-75b371ad-fc20-4bbe-82a0-fc7ac4a7ee76 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:18.454572 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-75b371ad-fc20-4bbe-82a0-fc7ac4a7ee76 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:18.454843 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d217e0bd-95f9-4ca4-8cde-cf530ebd7d14 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:18.456266 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-75b371ad-fc20-4bbe-82a0-fc7ac4a7ee76 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:19.317335 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-d217e0bd-95f9-4ca4-8cde-cf530ebd7d14 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:19.322872 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-75b371ad-fc20-4bbe-82a0-fc7ac4a7ee76 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:19.325365 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-d217e0bd-95f9-4ca4-8cde-cf530ebd7d14 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91" status: 200 len: 1510 microversion: 2.1 time: 0.901625 Sep 01 14:08:19.325950 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 139/290] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:18 2022] GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91 => generated 1510 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:19.335067 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-75b371ad-fc20-4bbe-82a0-fc7ac4a7ee76 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:19.337003 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-75b371ad-fc20-4bbe-82a0-fc7ac4a7ee76 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:19.338313 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-75b371ad-fc20-4bbe-82a0-fc7ac4a7ee76 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1746 microversion: 2.20 time: 0.926655 Sep 01 14:08:19.338894 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 152/291] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:08:18 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1746 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:08:20.226761 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [req-315be219-3ded-4a52-8db2-28de628fc0df req-3e07bca9-6a76-477f-9c4f-6a868ee0f54a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d39f7090-b419-46be-9fcc-7ae73004ab71", "name": "network-vif-plugged", "status": "completed", "tag": "9ae4ab09-714c-4175-ba0d-7b76b31e652d"}]} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:08:20.242521 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-315be219-3ded-4a52-8db2-28de628fc0df req-3e07bca9-6a76-477f-9c4f-6a868ee0f54a service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:20.243471 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-315be219-3ded-4a52-8db2-28de628fc0df req-3e07bca9-6a76-477f-9c4f-6a868ee0f54a service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:20.244136 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-315be219-3ded-4a52-8db2-28de628fc0df req-3e07bca9-6a76-477f-9c4f-6a868ee0f54a service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:20.259989 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.compute.server_external_events [req-315be219-3ded-4a52-8db2-28de628fc0df req-3e07bca9-6a76-477f-9c4f-6a868ee0f54a service nova] Creating event network-vif-plugged:9ae4ab09-714c-4175-ba0d-7b76b31e652d for instance d39f7090-b419-46be-9fcc-7ae73004ab71 on hv-cinder-85221 Sep 01 14:08:20.266089 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [req-315be219-3ded-4a52-8db2-28de628fc0df req-3e07bca9-6a76-477f-9c4f-6a868ee0f54a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045484 Sep 01 14:08:20.267333 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 140/292] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:08:20.348928 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-e23fe77f-7d3d-4a84-ad5b-22dcfac26a32 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:20.349518 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-e23fe77f-7d3d-4a84-ad5b-22dcfac26a32 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 846e670d-c808-44d5-be0e-9c36671fbe91] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:20.364332 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e23fe77f-7d3d-4a84-ad5b-22dcfac26a32 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:20.365251 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e23fe77f-7d3d-4a84-ad5b-22dcfac26a32 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:20.366150 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e23fe77f-7d3d-4a84-ad5b-22dcfac26a32 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:20.367274 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e23fe77f-7d3d-4a84-ad5b-22dcfac26a32 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:20.368340 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e23fe77f-7d3d-4a84-ad5b-22dcfac26a32 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:20.369296 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e23fe77f-7d3d-4a84-ad5b-22dcfac26a32 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:20.375034 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-129ae0df-af89-4262-9fa0-080d762ac2d5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:20.382179 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-129ae0df-af89-4262-9fa0-080d762ac2d5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:20.393518 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-129ae0df-af89-4262-9fa0-080d762ac2d5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:20.395289 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-129ae0df-af89-4262-9fa0-080d762ac2d5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:20.395289 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-129ae0df-af89-4262-9fa0-080d762ac2d5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:20.395289 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-129ae0df-af89-4262-9fa0-080d762ac2d5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:20.395715 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-129ae0df-af89-4262-9fa0-080d762ac2d5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:20.395954 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-129ae0df-af89-4262-9fa0-080d762ac2d5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:20.620567 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-e23fe77f-7d3d-4a84-ad5b-22dcfac26a32 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:20.622001 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-129ae0df-af89-4262-9fa0-080d762ac2d5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:20.631849 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-129ae0df-af89-4262-9fa0-080d762ac2d5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:20.633301 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-129ae0df-af89-4262-9fa0-080d762ac2d5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:20.634281 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-e23fe77f-7d3d-4a84-ad5b-22dcfac26a32 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91" status: 200 len: 1510 microversion: 2.1 time: 0.290353 Sep 01 14:08:20.634511 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-129ae0df-af89-4262-9fa0-080d762ac2d5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1741 microversion: 2.20 time: 0.275275 Sep 01 14:08:20.635243 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 153/293] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:20 2022] GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91 => generated 1510 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:20.635441 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 141/294] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:08:20 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1741 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:08:21.660655 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-93976c88-5363-4450-95f9-efe25de30e80 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:21.661479 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-93976c88-5363-4450-95f9-efe25de30e80 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:21.673431 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-91e4ef96-6dcf-4d4c-951d-06f4ec4c79a0 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:21.674305 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-91e4ef96-6dcf-4d4c-951d-06f4ec4c79a0 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 846e670d-c808-44d5-be0e-9c36671fbe91] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:21.683966 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-93976c88-5363-4450-95f9-efe25de30e80 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:21.683966 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-93976c88-5363-4450-95f9-efe25de30e80 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:21.683966 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-93976c88-5363-4450-95f9-efe25de30e80 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:21.683966 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-93976c88-5363-4450-95f9-efe25de30e80 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:21.684676 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-93976c88-5363-4450-95f9-efe25de30e80 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:21.684676 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-93976c88-5363-4450-95f9-efe25de30e80 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:21.698362 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-91e4ef96-6dcf-4d4c-951d-06f4ec4c79a0 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:21.699474 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-91e4ef96-6dcf-4d4c-951d-06f4ec4c79a0 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:21.700272 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-91e4ef96-6dcf-4d4c-951d-06f4ec4c79a0 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:21.701505 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-91e4ef96-6dcf-4d4c-951d-06f4ec4c79a0 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:21.702391 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-91e4ef96-6dcf-4d4c-951d-06f4ec4c79a0 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:21.703105 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-91e4ef96-6dcf-4d4c-951d-06f4ec4c79a0 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:22.178283 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-93976c88-5363-4450-95f9-efe25de30e80 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:22.191269 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-91e4ef96-6dcf-4d4c-951d-06f4ec4c79a0 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:22.194097 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-93976c88-5363-4450-95f9-efe25de30e80 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:22.196008 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-93976c88-5363-4450-95f9-efe25de30e80 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:22.197483 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-93976c88-5363-4450-95f9-efe25de30e80 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1741 microversion: 2.20 time: 0.541810 Sep 01 14:08:22.198818 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 154/295] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:08:21 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1741 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:08:22.214912 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-91e4ef96-6dcf-4d4c-951d-06f4ec4c79a0 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91" status: 200 len: 1510 microversion: 2.1 time: 0.545183 Sep 01 14:08:22.215817 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 142/296] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:21 2022] GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91 => generated 1510 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:08:22.893531 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-a5ff2c6c-b16e-4318-bec6-2e302f071359 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:08:22.906101 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a5ff2c6c-b16e-4318-bec6-2e302f071359 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:22.907358 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a5ff2c6c-b16e-4318-bec6-2e302f071359 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:22.908486 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a5ff2c6c-b16e-4318-bec6-2e302f071359 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:23.058170 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-a5ff2c6c-b16e-4318-bec6-2e302f071359 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Going to try to stop instance {{(pid=121340) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 01 14:08:23.228003 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-54a4d7be-e784-4262-bef7-c11153cd8cd4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:23.231257 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-54a4d7be-e784-4262-bef7-c11153cd8cd4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:23.255492 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-54a4d7be-e784-4262-bef7-c11153cd8cd4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:23.256655 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-54a4d7be-e784-4262-bef7-c11153cd8cd4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:23.257362 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-54a4d7be-e784-4262-bef7-c11153cd8cd4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:23.259392 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-54a4d7be-e784-4262-bef7-c11153cd8cd4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:23.259932 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-54a4d7be-e784-4262-bef7-c11153cd8cd4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:23.260432 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-54a4d7be-e784-4262-bef7-c11153cd8cd4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:23.413276 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-a5ff2c6c-b16e-4318-bec6-2e302f071359 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "POST /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7/action" status: 202 len: 0 microversion: 2.1 time: 0.523437 Sep 01 14:08:23.424905 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 155/297] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Sep 1 14:08:22 2022] POST /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7/action => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:08:23.424905 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-b25c08b8-5bc4-473d-b460-4aa57d6864c1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:23.424905 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-b25c08b8-5bc4-473d-b460-4aa57d6864c1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 846e670d-c808-44d5-be0e-9c36671fbe91] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:23.433852 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b25c08b8-5bc4-473d-b460-4aa57d6864c1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:23.435348 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b25c08b8-5bc4-473d-b460-4aa57d6864c1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:23.436718 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b25c08b8-5bc4-473d-b460-4aa57d6864c1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:23.438075 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b25c08b8-5bc4-473d-b460-4aa57d6864c1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:23.439121 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b25c08b8-5bc4-473d-b460-4aa57d6864c1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:23.440885 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b25c08b8-5bc4-473d-b460-4aa57d6864c1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:23.710651 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-54a4d7be-e784-4262-bef7-c11153cd8cd4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:23.735915 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-54a4d7be-e784-4262-bef7-c11153cd8cd4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:23.739081 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-54a4d7be-e784-4262-bef7-c11153cd8cd4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:23.741192 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-54a4d7be-e784-4262-bef7-c11153cd8cd4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1741 microversion: 2.20 time: 0.517446 Sep 01 14:08:23.742432 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 143/298] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:08:23 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1741 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:08:23.747603 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-b5eb6b0c-92cd-485d-bc7b-37602e495716 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:23.748847 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-b5eb6b0c-92cd-485d-bc7b-37602e495716 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:23.756369 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b5eb6b0c-92cd-485d-bc7b-37602e495716 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:23.757186 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b5eb6b0c-92cd-485d-bc7b-37602e495716 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:23.757797 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b5eb6b0c-92cd-485d-bc7b-37602e495716 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:23.759108 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b5eb6b0c-92cd-485d-bc7b-37602e495716 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:23.759753 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b5eb6b0c-92cd-485d-bc7b-37602e495716 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:23.760461 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b5eb6b0c-92cd-485d-bc7b-37602e495716 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:24.039606 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-b25c08b8-5bc4-473d-b460-4aa57d6864c1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:24.051639 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-b25c08b8-5bc4-473d-b460-4aa57d6864c1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91" status: 200 len: 1516 microversion: 2.1 time: 0.636211 Sep 01 14:08:24.053057 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 156/299] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:23 2022] GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91 => generated 1516 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:24.076371 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-b5eb6b0c-92cd-485d-bc7b-37602e495716 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:24.087277 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-b5eb6b0c-92cd-485d-bc7b-37602e495716 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1724 microversion: 2.1 time: 0.342532 Sep 01 14:08:24.088216 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 144/300] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:23 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1724 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:24.770037 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-84e86406-3f3a-4912-ba71-3dc7354e6cda tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:24.770905 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-84e86406-3f3a-4912-ba71-3dc7354e6cda tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:24.792095 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-84e86406-3f3a-4912-ba71-3dc7354e6cda tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:24.794545 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-84e86406-3f3a-4912-ba71-3dc7354e6cda tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:24.796092 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-84e86406-3f3a-4912-ba71-3dc7354e6cda tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:24.797088 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-84e86406-3f3a-4912-ba71-3dc7354e6cda tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:24.801227 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-84e86406-3f3a-4912-ba71-3dc7354e6cda tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:24.802734 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-84e86406-3f3a-4912-ba71-3dc7354e6cda tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:25.115389 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-0e08dd45-4ba3-4194-bd43-7a15ecc87374 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:25.116250 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-0e08dd45-4ba3-4194-bd43-7a15ecc87374 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:25.135568 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0e08dd45-4ba3-4194-bd43-7a15ecc87374 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:25.136699 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0e08dd45-4ba3-4194-bd43-7a15ecc87374 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:25.137317 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0e08dd45-4ba3-4194-bd43-7a15ecc87374 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:25.140023 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0e08dd45-4ba3-4194-bd43-7a15ecc87374 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:25.144932 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0e08dd45-4ba3-4194-bd43-7a15ecc87374 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:25.149196 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0e08dd45-4ba3-4194-bd43-7a15ecc87374 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:25.161101 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-84e86406-3f3a-4912-ba71-3dc7354e6cda tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:25.208500 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-84e86406-3f3a-4912-ba71-3dc7354e6cda tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:25.218836 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-84e86406-3f3a-4912-ba71-3dc7354e6cda tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:25.220533 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-84e86406-3f3a-4912-ba71-3dc7354e6cda tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1741 microversion: 2.20 time: 0.455849 Sep 01 14:08:25.226163 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 157/301] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:08:24 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1741 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:08:25.590995 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-0e08dd45-4ba3-4194-bd43-7a15ecc87374 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:25.619319 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-0e08dd45-4ba3-4194-bd43-7a15ecc87374 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1724 microversion: 2.1 time: 0.508993 Sep 01 14:08:25.620911 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 145/302] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:25 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1724 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:08:26.247473 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-bc59a325-ce70-4d0d-8bab-6cfccd5d377f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Action: 'create', calling method: .version_select at 0x7f9867d13dc0>, body: {"keypair": {"name": "tempest-keypair-1064279577", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFlx65R6gm2f+TrwD2MYE3b2avE+25NfXeMfVMhHYJVptfBVc5+/Xwe1brqP4GmKE6UlqAnQzR2rZ2haOGVsAXYSoVAULTMkCjcgEOsEwHiNji87AA4ASJz8mooFO1MXSA=="}} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:08:26.267712 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.quota [None req-bc59a325-ce70-4d0d-8bab-6cfccd5d377f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Getting quotas for project 36049d2090b84443a3bf3bf00558379e. Resources: {'key_pairs'} {{(pid=121340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:08:26.271634 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-a6ce0582-f103-4933-8ed0-fa97ec4973a2 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:26.272529 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-a6ce0582-f103-4933-8ed0-fa97ec4973a2 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:26.273278 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.quota [None req-bc59a325-ce70-4d0d-8bab-6cfccd5d377f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Getting quotas for user 7562a0429fdf42948174b517b211884f and project 36049d2090b84443a3bf3bf00558379e. Resources: {'key_pairs'} {{(pid=121340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:08:26.280029 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a6ce0582-f103-4933-8ed0-fa97ec4973a2 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:26.280522 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a6ce0582-f103-4933-8ed0-fa97ec4973a2 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:26.282448 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a6ce0582-f103-4933-8ed0-fa97ec4973a2 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:26.282448 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a6ce0582-f103-4933-8ed0-fa97ec4973a2 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:26.282448 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a6ce0582-f103-4933-8ed0-fa97ec4973a2 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:26.282779 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a6ce0582-f103-4933-8ed0-fa97ec4973a2 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:26.449883 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-a6ce0582-f103-4933-8ed0-fa97ec4973a2 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:26.459870 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-a6ce0582-f103-4933-8ed0-fa97ec4973a2 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:26.461512 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-a6ce0582-f103-4933-8ed0-fa97ec4973a2 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:26.462996 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-a6ce0582-f103-4933-8ed0-fa97ec4973a2 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1741 microversion: 2.20 time: 0.196439 Sep 01 14:08:26.463659 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 146/303] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:08:26 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1741 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:08:26.652634 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-ceee3cb0-d200-4a6e-add2-3f46ff0a70b7 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:26.653253 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-ceee3cb0-d200-4a6e-add2-3f46ff0a70b7 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:26.660539 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ceee3cb0-d200-4a6e-add2-3f46ff0a70b7 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:26.661078 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ceee3cb0-d200-4a6e-add2-3f46ff0a70b7 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:26.661518 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ceee3cb0-d200-4a6e-add2-3f46ff0a70b7 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:26.662307 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ceee3cb0-d200-4a6e-add2-3f46ff0a70b7 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:26.662810 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ceee3cb0-d200-4a6e-add2-3f46ff0a70b7 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:26.663255 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ceee3cb0-d200-4a6e-add2-3f46ff0a70b7 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:26.680404 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:26.769691 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-bc59a325-ce70-4d0d-8bab-6cfccd5d377f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.524709 Sep 01 14:08:26.769851 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 158/304] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Sep 1 14:08:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:08:26.847744 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-ceee3cb0-d200-4a6e-add2-3f46ff0a70b7 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:26.862442 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-ceee3cb0-d200-4a6e-add2-3f46ff0a70b7 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1724 microversion: 2.1 time: 0.212929 Sep 01 14:08:26.866358 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 147/305] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:26 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:08:27.486452 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-78fd806b-88f1-4378-8dc8-59b78b051ecc tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:27.491839 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-78fd806b-88f1-4378-8dc8-59b78b051ecc tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:27.504925 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-78fd806b-88f1-4378-8dc8-59b78b051ecc tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:27.508918 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-78fd806b-88f1-4378-8dc8-59b78b051ecc tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:27.509705 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-78fd806b-88f1-4378-8dc8-59b78b051ecc tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:27.515145 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-78fd806b-88f1-4378-8dc8-59b78b051ecc tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:27.516012 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-78fd806b-88f1-4378-8dc8-59b78b051ecc tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:27.517380 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-78fd806b-88f1-4378-8dc8-59b78b051ecc tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:27.873364 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-78fd806b-88f1-4378-8dc8-59b78b051ecc tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:27.885755 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-86204af2-2a66-4525-83d0-1af5206d2047 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:27.887389 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-86204af2-2a66-4525-83d0-1af5206d2047 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:27.900111 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-86204af2-2a66-4525-83d0-1af5206d2047 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:27.905184 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-78fd806b-88f1-4378-8dc8-59b78b051ecc tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:27.907892 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-78fd806b-88f1-4378-8dc8-59b78b051ecc tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:27.910884 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-86204af2-2a66-4525-83d0-1af5206d2047 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:27.911466 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-86204af2-2a66-4525-83d0-1af5206d2047 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:27.913792 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-78fd806b-88f1-4378-8dc8-59b78b051ecc tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1741 microversion: 2.20 time: 0.431154 Sep 01 14:08:27.927742 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-86204af2-2a66-4525-83d0-1af5206d2047 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:27.927742 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-86204af2-2a66-4525-83d0-1af5206d2047 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:27.927742 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-86204af2-2a66-4525-83d0-1af5206d2047 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:27.933342 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 159/306] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:08:27 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1741 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:08:28.276210 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-86204af2-2a66-4525-83d0-1af5206d2047 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:28.286051 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-86204af2-2a66-4525-83d0-1af5206d2047 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1724 microversion: 2.1 time: 0.404617 Sep 01 14:08:28.299209 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 148/307] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:27 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1724 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:28.943592 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-83894a0b-9d61-4934-867f-1e700e6862c9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:28.944831 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-83894a0b-9d61-4934-867f-1e700e6862c9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:28.970559 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-83894a0b-9d61-4934-867f-1e700e6862c9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:28.970559 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-83894a0b-9d61-4934-867f-1e700e6862c9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:28.970559 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-83894a0b-9d61-4934-867f-1e700e6862c9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:28.970559 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-83894a0b-9d61-4934-867f-1e700e6862c9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:28.971448 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-83894a0b-9d61-4934-867f-1e700e6862c9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:28.971448 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-83894a0b-9d61-4934-867f-1e700e6862c9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:29.188831 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-83894a0b-9d61-4934-867f-1e700e6862c9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:29.212650 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-83894a0b-9d61-4934-867f-1e700e6862c9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:29.214226 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-83894a0b-9d61-4934-867f-1e700e6862c9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:29.215448 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-83894a0b-9d61-4934-867f-1e700e6862c9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1741 microversion: 2.20 time: 0.278083 Sep 01 14:08:29.216017 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 160/308] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:08:28 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1741 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:08:29.328837 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-027317ce-f688-42e2-a37d-1572526e2f84 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:29.333166 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-027317ce-f688-42e2-a37d-1572526e2f84 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:29.356920 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-027317ce-f688-42e2-a37d-1572526e2f84 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:29.358558 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-027317ce-f688-42e2-a37d-1572526e2f84 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:29.359662 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-027317ce-f688-42e2-a37d-1572526e2f84 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:29.361231 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-027317ce-f688-42e2-a37d-1572526e2f84 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:29.363718 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-027317ce-f688-42e2-a37d-1572526e2f84 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:29.364839 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-027317ce-f688-42e2-a37d-1572526e2f84 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:30.132160 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-027317ce-f688-42e2-a37d-1572526e2f84 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:30.145183 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-027317ce-f688-42e2-a37d-1572526e2f84 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1724 microversion: 2.1 time: 0.838042 Sep 01 14:08:30.149425 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 149/309] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:29 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1724 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:08:30.259307 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-bbc2d83e-dbf9-4943-97fa-02b29e779535 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:30.261095 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-bbc2d83e-dbf9-4943-97fa-02b29e779535 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:30.274364 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bbc2d83e-dbf9-4943-97fa-02b29e779535 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:30.276046 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bbc2d83e-dbf9-4943-97fa-02b29e779535 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:30.276930 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bbc2d83e-dbf9-4943-97fa-02b29e779535 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:30.278437 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bbc2d83e-dbf9-4943-97fa-02b29e779535 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:30.279153 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bbc2d83e-dbf9-4943-97fa-02b29e779535 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:30.279905 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bbc2d83e-dbf9-4943-97fa-02b29e779535 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:30.547714 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-bbc2d83e-dbf9-4943-97fa-02b29e779535 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:30.565852 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-bbc2d83e-dbf9-4943-97fa-02b29e779535 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:30.568115 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-bbc2d83e-dbf9-4943-97fa-02b29e779535 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:30.569397 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-bbc2d83e-dbf9-4943-97fa-02b29e779535 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1741 microversion: 2.20 time: 0.319301 Sep 01 14:08:30.582288 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 161/310] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:08:30 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1741 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:08:31.176446 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-c93a5c09-8c28-4f2d-91f0-51df04a9b525 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:31.177093 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-c93a5c09-8c28-4f2d-91f0-51df04a9b525 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:31.183941 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c93a5c09-8c28-4f2d-91f0-51df04a9b525 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:31.184429 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c93a5c09-8c28-4f2d-91f0-51df04a9b525 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:31.184863 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c93a5c09-8c28-4f2d-91f0-51df04a9b525 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:31.185564 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c93a5c09-8c28-4f2d-91f0-51df04a9b525 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:31.186293 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c93a5c09-8c28-4f2d-91f0-51df04a9b525 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:31.187067 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c93a5c09-8c28-4f2d-91f0-51df04a9b525 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:31.517041 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-c93a5c09-8c28-4f2d-91f0-51df04a9b525 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:31.541879 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-c93a5c09-8c28-4f2d-91f0-51df04a9b525 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1724 microversion: 2.1 time: 0.369564 Sep 01 14:08:31.567057 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 150/311] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:31 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1724 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:31.609965 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-c73d189a-4fe0-4663-8c63-47cb3192b395 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:31.611879 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-c73d189a-4fe0-4663-8c63-47cb3192b395 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:31.618872 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:31.630153 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c73d189a-4fe0-4663-8c63-47cb3192b395 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:31.631283 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c73d189a-4fe0-4663-8c63-47cb3192b395 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:31.654087 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c73d189a-4fe0-4663-8c63-47cb3192b395 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:31.654087 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c73d189a-4fe0-4663-8c63-47cb3192b395 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:31.654087 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c73d189a-4fe0-4663-8c63-47cb3192b395 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:31.654087 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c73d189a-4fe0-4663-8c63-47cb3192b395 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:31.904175 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-c73d189a-4fe0-4663-8c63-47cb3192b395 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:31.913578 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-c73d189a-4fe0-4663-8c63-47cb3192b395 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:31.915089 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-c73d189a-4fe0-4663-8c63-47cb3192b395 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:31.916358 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-c73d189a-4fe0-4663-8c63-47cb3192b395 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1741 microversion: 2.20 time: 0.323727 Sep 01 14:08:31.916908 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 162/312] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:08:31 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1741 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:08:32.586399 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-92555eb8-a433-426f-8723-1f32d3a9031a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:32.587276 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-92555eb8-a433-426f-8723-1f32d3a9031a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:32.603043 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-92555eb8-a433-426f-8723-1f32d3a9031a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:32.604798 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-92555eb8-a433-426f-8723-1f32d3a9031a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:32.604798 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-92555eb8-a433-426f-8723-1f32d3a9031a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:32.644396 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-92555eb8-a433-426f-8723-1f32d3a9031a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:32.645495 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-92555eb8-a433-426f-8723-1f32d3a9031a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:32.659117 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-92555eb8-a433-426f-8723-1f32d3a9031a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:32.948035 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-fa7ee9bf-fa3f-4752-a209-8b59170dd300 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:32.962686 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-fa7ee9bf-fa3f-4752-a209-8b59170dd300 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:32.981307 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-fa7ee9bf-fa3f-4752-a209-8b59170dd300 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:32.983773 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-fa7ee9bf-fa3f-4752-a209-8b59170dd300 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:32.984038 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-fa7ee9bf-fa3f-4752-a209-8b59170dd300 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:32.985070 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-fa7ee9bf-fa3f-4752-a209-8b59170dd300 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:32.987237 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-fa7ee9bf-fa3f-4752-a209-8b59170dd300 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:32.989701 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-fa7ee9bf-fa3f-4752-a209-8b59170dd300 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:33.002864 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:33.088235 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-92555eb8-a433-426f-8723-1f32d3a9031a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:33.151815 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-92555eb8-a433-426f-8723-1f32d3a9031a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1724 microversion: 2.1 time: 0.574220 Sep 01 14:08:33.155041 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 151/313] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:32 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1724 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:33.370407 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-2f61d8b0-52d6-4826-ae5e-7cf051523d34 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-907243986", "imageRef": "9be77128-e763-4225-b76f-85fbb04ad9b2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9cdd4113-f7e0-45eb-bbb2-5da93102bf6c"}], "security_groups": [{"name": "tempest-securitygroup--1132779017"}], "key_name": "tempest-keypair-1064279577", "user_data": "}} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:08:33.476342 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-fa7ee9bf-fa3f-4752-a209-8b59170dd300 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:33.486129 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-fa7ee9bf-fa3f-4752-a209-8b59170dd300 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:33.488568 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-fa7ee9bf-fa3f-4752-a209-8b59170dd300 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:33.490380 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-fa7ee9bf-fa3f-4752-a209-8b59170dd300 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1741 microversion: 2.20 time: 0.550746 Sep 01 14:08:33.508734 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 163/314] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:08:32 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1741 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:08:33.606525 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.network.neutron [None req-2f61d8b0-52d6-4826-ae5e-7cf051523d34 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] validate_networks() for [('9cdd4113-f7e0-45eb-bbb2-5da93102bf6c', None, None, None, None, None)] {{(pid=121339) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:08:34.197221 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-9bf584e7-5b96-4bcc-8889-de37db566607 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:34.198487 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-9bf584e7-5b96-4bcc-8889-de37db566607 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:34.252296 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9bf584e7-5b96-4bcc-8889-de37db566607 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:34.261571 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9bf584e7-5b96-4bcc-8889-de37db566607 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:34.269368 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9bf584e7-5b96-4bcc-8889-de37db566607 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:34.271181 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9bf584e7-5b96-4bcc-8889-de37db566607 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:34.288115 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9bf584e7-5b96-4bcc-8889-de37db566607 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:34.288915 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9bf584e7-5b96-4bcc-8889-de37db566607 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:34.777421 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.virt.hardware [None req-2f61d8b0-52d6-4826-ae5e-7cf051523d34 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Flavor limits 0:0:0 {{(pid=121339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:08:34.781031 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.virt.hardware [None req-2f61d8b0-52d6-4826-ae5e-7cf051523d34 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Image limits 0:0:0 {{(pid=121339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:08:34.781672 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.virt.hardware [None req-2f61d8b0-52d6-4826-ae5e-7cf051523d34 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Flavor pref 0:0:0 {{(pid=121339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:08:34.782506 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.virt.hardware [None req-2f61d8b0-52d6-4826-ae5e-7cf051523d34 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Image pref 0:0:0 {{(pid=121339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:08:34.783098 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.virt.hardware [None req-2f61d8b0-52d6-4826-ae5e-7cf051523d34 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:08:34.802525 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2f61d8b0-52d6-4826-ae5e-7cf051523d34 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:34.805802 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2f61d8b0-52d6-4826-ae5e-7cf051523d34 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:34.806562 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2f61d8b0-52d6-4826-ae5e-7cf051523d34 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:34.809868 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2f61d8b0-52d6-4826-ae5e-7cf051523d34 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:34.811172 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2f61d8b0-52d6-4826-ae5e-7cf051523d34 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:34.812202 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2f61d8b0-52d6-4826-ae5e-7cf051523d34 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:34.866971 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-9bf584e7-5b96-4bcc-8889-de37db566607 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:34.870537 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.quota [None req-2f61d8b0-52d6-4826-ae5e-7cf051523d34 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Getting quotas for project 36049d2090b84443a3bf3bf00558379e. Resources: {'cores', 'instances', 'ram'} {{(pid=121339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:08:34.876427 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.quota [None req-2f61d8b0-52d6-4826-ae5e-7cf051523d34 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Getting quotas for user 7562a0429fdf42948174b517b211884f and project 36049d2090b84443a3bf3bf00558379e. Resources: {'cores', 'instances', 'ram'} {{(pid=121339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:08:34.892390 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-2f61d8b0-52d6-4826-ae5e-7cf051523d34 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Going to run 1 instances... {{(pid=121339) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:08:34.896503 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-2f61d8b0-52d6-4826-ae5e-7cf051523d34 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9be77128-e763-4225-b76f-85fbb04ad9b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:08:34.902842 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-9bf584e7-5b96-4bcc-8889-de37db566607 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1724 microversion: 2.1 time: 0.712919 Sep 01 14:08:34.914436 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 164/315] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:34 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1724 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:34.925359 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-0099022a-b3cb-4fe9-95ef-6161321d4fd7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:34.928946 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-0099022a-b3cb-4fe9-95ef-6161321d4fd7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:34.938114 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0099022a-b3cb-4fe9-95ef-6161321d4fd7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:34.938922 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0099022a-b3cb-4fe9-95ef-6161321d4fd7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:34.940361 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0099022a-b3cb-4fe9-95ef-6161321d4fd7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:34.941415 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0099022a-b3cb-4fe9-95ef-6161321d4fd7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:34.942088 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0099022a-b3cb-4fe9-95ef-6161321d4fd7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:34.942710 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0099022a-b3cb-4fe9-95ef-6161321d4fd7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:35.185888 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-2f61d8b0-52d6-4826-ae5e-7cf051523d34 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.825911 Sep 01 14:08:35.196842 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 152/316] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 1 14:08:33 2022] POST /compute/v2.1/servers => generated 409 bytes in 1837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 14:08:35.210988 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-17991cec-8889-4cb3-9a1b-c2bd016b278c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:35.212520 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-17991cec-8889-4cb3-9a1b-c2bd016b278c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:35.261338 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-0099022a-b3cb-4fe9-95ef-6161321d4fd7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:35.272899 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-0099022a-b3cb-4fe9-95ef-6161321d4fd7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:35.283373 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-0099022a-b3cb-4fe9-95ef-6161321d4fd7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:35.288188 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-0099022a-b3cb-4fe9-95ef-6161321d4fd7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1741 microversion: 2.20 time: 0.371273 Sep 01 14:08:35.306419 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 165/317] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:08:34 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1741 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:08:35.357713 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-17991cec-8889-4cb3-9a1b-c2bd016b278c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:35.367751 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-17991cec-8889-4cb3-9a1b-c2bd016b278c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1245 microversion: 2.1 time: 0.168640 Sep 01 14:08:35.370671 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 153/318] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:35 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1245 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:35.934611 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-d1d00609-b040-4d75-89da-308ec27e2448 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:35.935296 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-d1d00609-b040-4d75-89da-308ec27e2448 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:35.956032 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d1d00609-b040-4d75-89da-308ec27e2448 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:35.956826 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d1d00609-b040-4d75-89da-308ec27e2448 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:35.957407 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d1d00609-b040-4d75-89da-308ec27e2448 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:35.980458 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d1d00609-b040-4d75-89da-308ec27e2448 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:35.981008 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d1d00609-b040-4d75-89da-308ec27e2448 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:35.981585 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d1d00609-b040-4d75-89da-308ec27e2448 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:36.281674 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell0:SELECT=4 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:36.341574 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-c6aad730-c3cc-4ccc-8962-c62ccbadc0c7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:36.343754 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-c6aad730-c3cc-4ccc-8962-c62ccbadc0c7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:36.381731 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:36.401619 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c6aad730-c3cc-4ccc-8962-c62ccbadc0c7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:36.403823 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c6aad730-c3cc-4ccc-8962-c62ccbadc0c7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:36.406555 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c6aad730-c3cc-4ccc-8962-c62ccbadc0c7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:36.411804 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c6aad730-c3cc-4ccc-8962-c62ccbadc0c7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:36.416907 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c6aad730-c3cc-4ccc-8962-c62ccbadc0c7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:36.418930 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c6aad730-c3cc-4ccc-8962-c62ccbadc0c7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:36.777619 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-d1d00609-b040-4d75-89da-308ec27e2448 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:36.840703 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-d1d00609-b040-4d75-89da-308ec27e2448 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1724 microversion: 2.1 time: 0.914266 Sep 01 14:08:36.885097 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 166/319] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:35 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1724 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:36.894633 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-26c67fd5-434d-4434-918a-ff7843ac1d7b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:36.895732 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-26c67fd5-434d-4434-918a-ff7843ac1d7b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:36.914317 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-c6aad730-c3cc-4ccc-8962-c62ccbadc0c7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:36.926465 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-c6aad730-c3cc-4ccc-8962-c62ccbadc0c7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:36.928176 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-c6aad730-c3cc-4ccc-8962-c62ccbadc0c7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:36.929632 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-c6aad730-c3cc-4ccc-8962-c62ccbadc0c7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1741 microversion: 2.20 time: 0.599637 Sep 01 14:08:36.930721 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 154/320] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:08:36 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1741 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:08:37.041016 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-26c67fd5-434d-4434-918a-ff7843ac1d7b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:37.050830 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-26c67fd5-434d-4434-918a-ff7843ac1d7b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1245 microversion: 2.1 time: 0.164171 Sep 01 14:08:37.052042 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 167/321] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:36 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1245 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:37.891218 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-bc44000e-4a49-4df0-8e29-e7b02801fcc1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:37.897628 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-bc44000e-4a49-4df0-8e29-e7b02801fcc1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:37.943514 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-bc44000e-4a49-4df0-8e29-e7b02801fcc1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:37.944837 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-bc44000e-4a49-4df0-8e29-e7b02801fcc1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:37.945400 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-bc44000e-4a49-4df0-8e29-e7b02801fcc1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:37.946364 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-bc44000e-4a49-4df0-8e29-e7b02801fcc1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:37.947367 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-bc44000e-4a49-4df0-8e29-e7b02801fcc1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:37.947895 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-bc44000e-4a49-4df0-8e29-e7b02801fcc1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:37.987378 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-6766228c-cfb6-44e3-986f-40bd7ed63947 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:37.987378 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-6766228c-cfb6-44e3-986f-40bd7ed63947 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:37.995911 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6766228c-cfb6-44e3-986f-40bd7ed63947 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:37.997534 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6766228c-cfb6-44e3-986f-40bd7ed63947 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:37.997534 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6766228c-cfb6-44e3-986f-40bd7ed63947 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:38.020604 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6766228c-cfb6-44e3-986f-40bd7ed63947 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:38.022278 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6766228c-cfb6-44e3-986f-40bd7ed63947 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:38.023074 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6766228c-cfb6-44e3-986f-40bd7ed63947 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:38.345387 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-bc44000e-4a49-4df0-8e29-e7b02801fcc1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:38.383910 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-bc44000e-4a49-4df0-8e29-e7b02801fcc1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1724 microversion: 2.1 time: 0.500081 Sep 01 14:08:38.386709 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 155/322] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:37 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1724 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:38.399637 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-b954b0a9-30fe-4cbf-b4b7-95bcaa8b9db8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:38.400254 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-b954b0a9-30fe-4cbf-b4b7-95bcaa8b9db8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:38.414977 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b954b0a9-30fe-4cbf-b4b7-95bcaa8b9db8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:38.415471 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b954b0a9-30fe-4cbf-b4b7-95bcaa8b9db8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:38.415910 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b954b0a9-30fe-4cbf-b4b7-95bcaa8b9db8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:38.417343 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b954b0a9-30fe-4cbf-b4b7-95bcaa8b9db8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:38.422365 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b954b0a9-30fe-4cbf-b4b7-95bcaa8b9db8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:38.425553 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b954b0a9-30fe-4cbf-b4b7-95bcaa8b9db8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:38.544253 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-6766228c-cfb6-44e3-986f-40bd7ed63947 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:38.576841 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-6766228c-cfb6-44e3-986f-40bd7ed63947 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:38.578994 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-6766228c-cfb6-44e3-986f-40bd7ed63947 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:38.580921 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-6766228c-cfb6-44e3-986f-40bd7ed63947 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1741 microversion: 2.20 time: 0.603700 Sep 01 14:08:38.590697 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 168/323] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:08:37 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1741 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:08:38.632394 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-b954b0a9-30fe-4cbf-b4b7-95bcaa8b9db8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:38.641123 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-b954b0a9-30fe-4cbf-b4b7-95bcaa8b9db8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1249 microversion: 2.1 time: 0.253185 Sep 01 14:08:38.642054 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 156/324] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:38 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1249 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:39.431884 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-569fbdfd-01e3-4c51-878a-773e9e723692 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:39.434251 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-569fbdfd-01e3-4c51-878a-773e9e723692 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:39.447322 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-569fbdfd-01e3-4c51-878a-773e9e723692 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:39.462098 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-569fbdfd-01e3-4c51-878a-773e9e723692 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:39.463267 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-569fbdfd-01e3-4c51-878a-773e9e723692 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:39.464946 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-569fbdfd-01e3-4c51-878a-773e9e723692 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:39.469253 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-569fbdfd-01e3-4c51-878a-773e9e723692 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:39.476269 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-569fbdfd-01e3-4c51-878a-773e9e723692 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:39.631033 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-f1416392-98bc-4e55-b7b6-294c8bca5c06 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:39.631677 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-f1416392-98bc-4e55-b7b6-294c8bca5c06 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:39.639618 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f1416392-98bc-4e55-b7b6-294c8bca5c06 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:39.640458 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f1416392-98bc-4e55-b7b6-294c8bca5c06 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:39.641107 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f1416392-98bc-4e55-b7b6-294c8bca5c06 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:39.642127 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f1416392-98bc-4e55-b7b6-294c8bca5c06 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:39.643461 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f1416392-98bc-4e55-b7b6-294c8bca5c06 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:39.644197 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f1416392-98bc-4e55-b7b6-294c8bca5c06 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:40.031850 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-569fbdfd-01e3-4c51-878a-773e9e723692 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:40.041866 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-569fbdfd-01e3-4c51-878a-773e9e723692 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1724 microversion: 2.1 time: 0.622213 Sep 01 14:08:40.047979 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 169/325] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:39 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1724 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:40.060250 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-e03399a3-88f2-4cf1-86f8-61fe3d7578d5 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:40.065124 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-e03399a3-88f2-4cf1-86f8-61fe3d7578d5 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:40.079636 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e03399a3-88f2-4cf1-86f8-61fe3d7578d5 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:40.083658 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e03399a3-88f2-4cf1-86f8-61fe3d7578d5 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:40.084402 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e03399a3-88f2-4cf1-86f8-61fe3d7578d5 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:40.085549 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e03399a3-88f2-4cf1-86f8-61fe3d7578d5 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:40.086271 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e03399a3-88f2-4cf1-86f8-61fe3d7578d5 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:40.092086 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e03399a3-88f2-4cf1-86f8-61fe3d7578d5 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:40.281959 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-e03399a3-88f2-4cf1-86f8-61fe3d7578d5 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:40.292997 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-e03399a3-88f2-4cf1-86f8-61fe3d7578d5 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1241 microversion: 2.1 time: 0.241584 Sep 01 14:08:40.309336 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 170/326] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:40 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1241 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:40.412388 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-f1416392-98bc-4e55-b7b6-294c8bca5c06 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:40.427477 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-f1416392-98bc-4e55-b7b6-294c8bca5c06 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:40.440377 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-f1416392-98bc-4e55-b7b6-294c8bca5c06 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:40.444993 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-f1416392-98bc-4e55-b7b6-294c8bca5c06 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1741 microversion: 2.20 time: 0.821578 Sep 01 14:08:40.456241 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 157/327] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:08:39 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1741 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:08:40.847532 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-0ba68881-23dc-4b44-bd02-074f1d9b0cc3 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2048811336", "imageRef": "9be77128-e763-4225-b76f-85fbb04ad9b2", "flavorRef": "452", "networks": [{"uuid": "d1c0ee50-5f2f-4508-9ae2-29e7d03abfd0"}]}} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:08:41.008446 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.network.neutron [None req-0ba68881-23dc-4b44-bd02-074f1d9b0cc3 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] validate_networks() for [('d1c0ee50-5f2f-4508-9ae2-29e7d03abfd0', None, None, None, None, None)] {{(pid=121340) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:08:41.090998 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-2b8d473b-a520-43b9-af9d-109c84a7f600 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:41.093279 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-2b8d473b-a520-43b9-af9d-109c84a7f600 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:41.101497 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2b8d473b-a520-43b9-af9d-109c84a7f600 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:41.102402 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2b8d473b-a520-43b9-af9d-109c84a7f600 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:41.103332 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2b8d473b-a520-43b9-af9d-109c84a7f600 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:41.104116 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2b8d473b-a520-43b9-af9d-109c84a7f600 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:41.104580 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2b8d473b-a520-43b9-af9d-109c84a7f600 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:41.105193 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2b8d473b-a520-43b9-af9d-109c84a7f600 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:41.710359 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-2b8d473b-a520-43b9-af9d-109c84a7f600 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:41.742619 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-2b8d473b-a520-43b9-af9d-109c84a7f600 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1724 microversion: 2.1 time: 0.654590 Sep 01 14:08:41.744154 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 158/328] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:41 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1724 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:08:41.757014 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-5d49a3b2-7c83-4322-921b-3c7a7cfd39bb tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:41.784164 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-5d49a3b2-7c83-4322-921b-3c7a7cfd39bb tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:41.804834 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5d49a3b2-7c83-4322-921b-3c7a7cfd39bb tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:41.805768 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5d49a3b2-7c83-4322-921b-3c7a7cfd39bb tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:41.821415 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5d49a3b2-7c83-4322-921b-3c7a7cfd39bb tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:41.825497 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5d49a3b2-7c83-4322-921b-3c7a7cfd39bb tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:41.838756 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5d49a3b2-7c83-4322-921b-3c7a7cfd39bb tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:41.839395 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5d49a3b2-7c83-4322-921b-3c7a7cfd39bb tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:42.042300 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-5d49a3b2-7c83-4322-921b-3c7a7cfd39bb tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:42.063074 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-5d49a3b2-7c83-4322-921b-3c7a7cfd39bb tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1297 microversion: 2.1 time: 0.316896 Sep 01 14:08:42.073577 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 159/329] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:41 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1297 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:42.082618 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-ceca34e8-0821-4b84-be95-25702279d498 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:42.083617 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-ceca34e8-0821-4b84-be95-25702279d498 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:42.098610 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ceca34e8-0821-4b84-be95-25702279d498 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:42.099840 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ceca34e8-0821-4b84-be95-25702279d498 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:42.102424 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ceca34e8-0821-4b84-be95-25702279d498 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:42.103539 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ceca34e8-0821-4b84-be95-25702279d498 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:42.111314 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ceca34e8-0821-4b84-be95-25702279d498 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:42.113594 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ceca34e8-0821-4b84-be95-25702279d498 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:42.588757 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-0ba68881-23dc-4b44-bd02-074f1d9b0cc3 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Flavor limits 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:08:42.594166 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-ceca34e8-0821-4b84-be95-25702279d498 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:42.602197 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-0ba68881-23dc-4b44-bd02-074f1d9b0cc3 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Image limits 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:08:42.606081 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-0ba68881-23dc-4b44-bd02-074f1d9b0cc3 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Flavor pref 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:08:42.606500 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-0ba68881-23dc-4b44-bd02-074f1d9b0cc3 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Image pref 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:08:42.607088 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-0ba68881-23dc-4b44-bd02-074f1d9b0cc3 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:08:42.617246 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-ceca34e8-0821-4b84-be95-25702279d498 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:42.622417 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-ceca34e8-0821-4b84-be95-25702279d498 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:42.623649 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-ceca34e8-0821-4b84-be95-25702279d498 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1741 microversion: 2.20 time: 0.548611 Sep 01 14:08:42.625268 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 160/330] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:08:42 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1741 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:08:42.627277 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0ba68881-23dc-4b44-bd02-074f1d9b0cc3 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:42.627838 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0ba68881-23dc-4b44-bd02-074f1d9b0cc3 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:42.628440 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0ba68881-23dc-4b44-bd02-074f1d9b0cc3 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:42.629190 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0ba68881-23dc-4b44-bd02-074f1d9b0cc3 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:42.629650 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0ba68881-23dc-4b44-bd02-074f1d9b0cc3 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:42.630107 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0ba68881-23dc-4b44-bd02-074f1d9b0cc3 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:42.650022 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.quota [None req-0ba68881-23dc-4b44-bd02-074f1d9b0cc3 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Getting quotas for project 2e6d998735c243c3bcd08ca2e2d81ae9. Resources: {'cores', 'instances', 'ram'} {{(pid=121340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:08:42.655389 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.quota [None req-0ba68881-23dc-4b44-bd02-074f1d9b0cc3 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Getting quotas for user e53d275b44a2432a9fe8611304bcfa91 and project 2e6d998735c243c3bcd08ca2e2d81ae9. Resources: {'cores', 'instances', 'ram'} {{(pid=121340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:08:42.670092 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-0ba68881-23dc-4b44-bd02-074f1d9b0cc3 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Going to run 1 instances... {{(pid=121340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:08:42.672606 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-0ba68881-23dc-4b44-bd02-074f1d9b0cc3 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 81fe7593-66bc-442e-bd42-67dbb727a356] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9be77128-e763-4225-b76f-85fbb04ad9b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:08:42.781264 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-0a624f64-defe-4974-bce0-331d6d6e0119 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:42.782119 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-0a624f64-defe-4974-bce0-331d6d6e0119 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:42.791299 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0a624f64-defe-4974-bce0-331d6d6e0119 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:42.791801 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0a624f64-defe-4974-bce0-331d6d6e0119 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:42.793161 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0a624f64-defe-4974-bce0-331d6d6e0119 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:42.793924 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0a624f64-defe-4974-bce0-331d6d6e0119 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:42.794580 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0a624f64-defe-4974-bce0-331d6d6e0119 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:42.795014 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0a624f64-defe-4974-bce0-331d6d6e0119 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:42.862949 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-0ba68881-23dc-4b44-bd02-074f1d9b0cc3 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.025137 Sep 01 14:08:42.864458 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 171/331] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 1 14:08:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2028 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 14:08:42.878901 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-0aaa6d5f-64b3-4abe-9b09-f47fd9cc05c7 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:42.880239 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-0aaa6d5f-64b3-4abe-9b09-f47fd9cc05c7 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 81fe7593-66bc-442e-bd42-67dbb727a356] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:43.087895 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-0aaa6d5f-64b3-4abe-9b09-f47fd9cc05c7 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53d275b44a2432a9fe8611304bcfa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d998735c243c3bcd08ca2e2d81ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:43.105364 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-0aaa6d5f-64b3-4abe-9b09-f47fd9cc05c7 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356" status: 200 len: 1219 microversion: 2.1 time: 0.233125 Sep 01 14:08:43.108011 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 172/332] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:42 2022] GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356 => generated 1219 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:08:43.118314 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-8dbca27a-2b5e-4f9f-8b68-ed089d114412 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:43.119841 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-8dbca27a-2b5e-4f9f-8b68-ed089d114412 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:43.133984 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8dbca27a-2b5e-4f9f-8b68-ed089d114412 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:43.134938 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8dbca27a-2b5e-4f9f-8b68-ed089d114412 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:43.136031 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8dbca27a-2b5e-4f9f-8b68-ed089d114412 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:43.137804 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8dbca27a-2b5e-4f9f-8b68-ed089d114412 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:43.138905 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8dbca27a-2b5e-4f9f-8b68-ed089d114412 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:43.139679 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8dbca27a-2b5e-4f9f-8b68-ed089d114412 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:43.200551 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-0a624f64-defe-4974-bce0-331d6d6e0119 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:43.245646 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-0a624f64-defe-4974-bce0-331d6d6e0119 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1724 microversion: 2.1 time: 0.467554 Sep 01 14:08:43.264744 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 161/333] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:42 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1724 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:43.305119 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-8dbca27a-2b5e-4f9f-8b68-ed089d114412 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:43.314426 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-8dbca27a-2b5e-4f9f-8b68-ed089d114412 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1297 microversion: 2.1 time: 0.204640 Sep 01 14:08:43.315659 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 173/334] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:43 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1297 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:43.655654 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-98c8d7af-d88a-46b7-9258-7d4f0982bb75 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:43.657231 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-98c8d7af-d88a-46b7-9258-7d4f0982bb75 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:43.672906 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-98c8d7af-d88a-46b7-9258-7d4f0982bb75 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:43.673812 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-98c8d7af-d88a-46b7-9258-7d4f0982bb75 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:43.675299 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-98c8d7af-d88a-46b7-9258-7d4f0982bb75 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:43.677119 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-98c8d7af-d88a-46b7-9258-7d4f0982bb75 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:43.677869 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-98c8d7af-d88a-46b7-9258-7d4f0982bb75 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:43.678605 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-98c8d7af-d88a-46b7-9258-7d4f0982bb75 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:43.891378 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-98c8d7af-d88a-46b7-9258-7d4f0982bb75 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:43.901294 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-98c8d7af-d88a-46b7-9258-7d4f0982bb75 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:43.902802 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-98c8d7af-d88a-46b7-9258-7d4f0982bb75 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:43.904098 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-98c8d7af-d88a-46b7-9258-7d4f0982bb75 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1723 microversion: 2.20 time: 0.257274 Sep 01 14:08:43.904620 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 162/335] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:08:43 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1723 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:08:44.151296 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-0f7ab041-34cf-4534-b4dd-1e5dcd62d509 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:44.154545 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-0f7ab041-34cf-4534-b4dd-1e5dcd62d509 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 81fe7593-66bc-442e-bd42-67dbb727a356] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:44.298281 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-dbf685cd-2115-4129-9733-2b24902fd977 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:44.300089 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-dbf685cd-2115-4129-9733-2b24902fd977 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:44.326247 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-dbf685cd-2115-4129-9733-2b24902fd977 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:44.327165 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-dbf685cd-2115-4129-9733-2b24902fd977 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:44.328596 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-dbf685cd-2115-4129-9733-2b24902fd977 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:44.329987 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-dbf685cd-2115-4129-9733-2b24902fd977 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:44.332513 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-dbf685cd-2115-4129-9733-2b24902fd977 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:44.333373 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-dbf685cd-2115-4129-9733-2b24902fd977 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:44.435394 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-0f7ab041-34cf-4534-b4dd-1e5dcd62d509 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53d275b44a2432a9fe8611304bcfa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d998735c243c3bcd08ca2e2d81ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:44.461637 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-0f7ab041-34cf-4534-b4dd-1e5dcd62d509 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356" status: 200 len: 1219 microversion: 2.1 time: 0.309965 Sep 01 14:08:44.461637 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 174/336] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:44 2022] GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356 => generated 1219 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:44.471787 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-6a1ef830-7068-4f8a-9828-2786b6c912af tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:44.496618 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-6a1ef830-7068-4f8a-9828-2786b6c912af tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:44.527292 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6a1ef830-7068-4f8a-9828-2786b6c912af tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:44.528418 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6a1ef830-7068-4f8a-9828-2786b6c912af tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:44.530362 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6a1ef830-7068-4f8a-9828-2786b6c912af tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:44.531400 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6a1ef830-7068-4f8a-9828-2786b6c912af tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:44.533677 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6a1ef830-7068-4f8a-9828-2786b6c912af tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:44.534921 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6a1ef830-7068-4f8a-9828-2786b6c912af tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:44.716611 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-6a1ef830-7068-4f8a-9828-2786b6c912af tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:44.738224 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-6a1ef830-7068-4f8a-9828-2786b6c912af tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1297 microversion: 2.1 time: 0.278852 Sep 01 14:08:44.753951 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 175/337] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:44 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1297 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:44.816674 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-dbf685cd-2115-4129-9733-2b24902fd977 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:44.839836 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-dbf685cd-2115-4129-9733-2b24902fd977 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1724 microversion: 2.1 time: 0.554307 Sep 01 14:08:44.840909 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 163/338] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:44 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1724 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:08:44.960119 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-006a399e-85f2-403c-a85f-49b66e0435da tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:44.961276 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-006a399e-85f2-403c-a85f-49b66e0435da tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:44.973540 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-006a399e-85f2-403c-a85f-49b66e0435da tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:44.974489 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-006a399e-85f2-403c-a85f-49b66e0435da tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:44.975297 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-006a399e-85f2-403c-a85f-49b66e0435da tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:44.976702 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-006a399e-85f2-403c-a85f-49b66e0435da tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:44.977578 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-006a399e-85f2-403c-a85f-49b66e0435da tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:44.978441 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-006a399e-85f2-403c-a85f-49b66e0435da tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:45.255679 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-006a399e-85f2-403c-a85f-49b66e0435da tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:45.273449 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-006a399e-85f2-403c-a85f-49b66e0435da tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:45.279237 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-006a399e-85f2-403c-a85f-49b66e0435da tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:45.281631 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-006a399e-85f2-403c-a85f-49b66e0435da tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1723 microversion: 2.20 time: 0.336973 Sep 01 14:08:45.283768 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 176/339] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:08:44 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1723 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:08:45.496624 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-b44380c7-191f-4929-a545-e5566ff064e1 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:45.499138 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-b44380c7-191f-4929-a545-e5566ff064e1 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 81fe7593-66bc-442e-bd42-67dbb727a356] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:45.504437 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell0:SELECT=2 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:45.506362 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell0:SELECT=8 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:45.533536 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b44380c7-191f-4929-a545-e5566ff064e1 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:45.534763 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b44380c7-191f-4929-a545-e5566ff064e1 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:45.535981 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b44380c7-191f-4929-a545-e5566ff064e1 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:45.538476 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b44380c7-191f-4929-a545-e5566ff064e1 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:45.539347 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b44380c7-191f-4929-a545-e5566ff064e1 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:45.540172 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b44380c7-191f-4929-a545-e5566ff064e1 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:45.700057 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-b44380c7-191f-4929-a545-e5566ff064e1 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53d275b44a2432a9fe8611304bcfa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d998735c243c3bcd08ca2e2d81ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:45.715396 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-b44380c7-191f-4929-a545-e5566ff064e1 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356" status: 200 len: 1223 microversion: 2.1 time: 0.227685 Sep 01 14:08:45.716375 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 164/340] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:45 2022] GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356 => generated 1223 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:45.776471 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-3db5e3c4-1f8c-4709-bbbb-3478a6d741df tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:45.777268 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-3db5e3c4-1f8c-4709-bbbb-3478a6d741df tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:45.787972 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3db5e3c4-1f8c-4709-bbbb-3478a6d741df tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:45.788814 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3db5e3c4-1f8c-4709-bbbb-3478a6d741df tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:45.789573 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3db5e3c4-1f8c-4709-bbbb-3478a6d741df tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:45.791009 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3db5e3c4-1f8c-4709-bbbb-3478a6d741df tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:45.791787 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3db5e3c4-1f8c-4709-bbbb-3478a6d741df tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:45.792531 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3db5e3c4-1f8c-4709-bbbb-3478a6d741df tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:45.876015 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-fdf0ba9f-dd20-4254-abaf-79170aa74e9e tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:45.877171 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-fdf0ba9f-dd20-4254-abaf-79170aa74e9e tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:45.886134 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fdf0ba9f-dd20-4254-abaf-79170aa74e9e tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:45.887201 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fdf0ba9f-dd20-4254-abaf-79170aa74e9e tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:45.887987 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fdf0ba9f-dd20-4254-abaf-79170aa74e9e tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:45.889050 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fdf0ba9f-dd20-4254-abaf-79170aa74e9e tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:45.889693 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fdf0ba9f-dd20-4254-abaf-79170aa74e9e tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:45.890330 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fdf0ba9f-dd20-4254-abaf-79170aa74e9e tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:45.896033 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-3db5e3c4-1f8c-4709-bbbb-3478a6d741df tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:45.911414 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-3db5e3c4-1f8c-4709-bbbb-3478a6d741df tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1297 microversion: 2.1 time: 0.139440 Sep 01 14:08:45.917143 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 177/341] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:45 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1297 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:46.119062 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-fdf0ba9f-dd20-4254-abaf-79170aa74e9e tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:46.123202 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell1:SELECT=100 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:46.143458 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-fdf0ba9f-dd20-4254-abaf-79170aa74e9e tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1724 microversion: 2.1 time: 0.271981 Sep 01 14:08:46.144560 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 165/342] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:45 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1724 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:08:46.334759 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-1838ae54-0d59-4ee5-8fd4-feaad2a186c4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:46.336135 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-1838ae54-0d59-4ee5-8fd4-feaad2a186c4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:46.349030 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1838ae54-0d59-4ee5-8fd4-feaad2a186c4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:46.349733 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1838ae54-0d59-4ee5-8fd4-feaad2a186c4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:46.350537 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1838ae54-0d59-4ee5-8fd4-feaad2a186c4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:46.351854 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1838ae54-0d59-4ee5-8fd4-feaad2a186c4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:46.352513 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1838ae54-0d59-4ee5-8fd4-feaad2a186c4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:46.354612 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1838ae54-0d59-4ee5-8fd4-feaad2a186c4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:46.665476 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-1838ae54-0d59-4ee5-8fd4-feaad2a186c4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:46.688296 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-1838ae54-0d59-4ee5-8fd4-feaad2a186c4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:46.690550 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-1838ae54-0d59-4ee5-8fd4-feaad2a186c4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:46.692208 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-1838ae54-0d59-4ee5-8fd4-feaad2a186c4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1723 microversion: 2.20 time: 0.362985 Sep 01 14:08:46.693058 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 178/343] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:08:46 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1723 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:08:46.757564 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-4f259998-ccf9-4621-a394-279c69a5699b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:46.767036 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-4f259998-ccf9-4621-a394-279c69a5699b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 81fe7593-66bc-442e-bd42-67dbb727a356] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:46.800953 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4f259998-ccf9-4621-a394-279c69a5699b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:46.809328 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4f259998-ccf9-4621-a394-279c69a5699b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:46.810109 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4f259998-ccf9-4621-a394-279c69a5699b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:46.815683 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4f259998-ccf9-4621-a394-279c69a5699b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:46.816020 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4f259998-ccf9-4621-a394-279c69a5699b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:46.816888 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4f259998-ccf9-4621-a394-279c69a5699b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:46.943958 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-c32d327e-cf5c-4ecb-82d5-0a1a9d8d793f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:46.945031 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-c32d327e-cf5c-4ecb-82d5-0a1a9d8d793f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:46.952532 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-4f259998-ccf9-4621-a394-279c69a5699b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53d275b44a2432a9fe8611304bcfa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d998735c243c3bcd08ca2e2d81ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:46.953231 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c32d327e-cf5c-4ecb-82d5-0a1a9d8d793f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:46.954958 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c32d327e-cf5c-4ecb-82d5-0a1a9d8d793f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:46.955751 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c32d327e-cf5c-4ecb-82d5-0a1a9d8d793f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:46.958178 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c32d327e-cf5c-4ecb-82d5-0a1a9d8d793f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:46.959069 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c32d327e-cf5c-4ecb-82d5-0a1a9d8d793f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:46.959669 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c32d327e-cf5c-4ecb-82d5-0a1a9d8d793f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:46.982559 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-4f259998-ccf9-4621-a394-279c69a5699b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356" status: 200 len: 1223 microversion: 2.1 time: 0.233168 Sep 01 14:08:46.992279 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 166/344] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:46 2022] GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356 => generated 1223 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:47.092908 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-c32d327e-cf5c-4ecb-82d5-0a1a9d8d793f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:47.116058 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-c32d327e-cf5c-4ecb-82d5-0a1a9d8d793f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1297 microversion: 2.1 time: 0.176743 Sep 01 14:08:47.118245 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 179/345] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:46 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1297 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:08:47.174891 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-4fe095bc-0508-4d38-a5c2-baa298d9ee89 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:47.177002 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-4fe095bc-0508-4d38-a5c2-baa298d9ee89 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:47.191590 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4fe095bc-0508-4d38-a5c2-baa298d9ee89 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:47.193180 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4fe095bc-0508-4d38-a5c2-baa298d9ee89 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:47.193817 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4fe095bc-0508-4d38-a5c2-baa298d9ee89 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:47.194976 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4fe095bc-0508-4d38-a5c2-baa298d9ee89 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:47.195625 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4fe095bc-0508-4d38-a5c2-baa298d9ee89 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:47.196385 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4fe095bc-0508-4d38-a5c2-baa298d9ee89 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:47.382485 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-4fe095bc-0508-4d38-a5c2-baa298d9ee89 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:47.391949 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-4fe095bc-0508-4d38-a5c2-baa298d9ee89 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1724 microversion: 2.1 time: 0.225213 Sep 01 14:08:47.392867 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 167/346] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:47 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:47.726219 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-7acf483b-4548-4e52-9152-cf7cc215416c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:47.728375 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-7acf483b-4548-4e52-9152-cf7cc215416c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:47.739876 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7acf483b-4548-4e52-9152-cf7cc215416c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:47.741195 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7acf483b-4548-4e52-9152-cf7cc215416c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:47.742657 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7acf483b-4548-4e52-9152-cf7cc215416c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:47.744050 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7acf483b-4548-4e52-9152-cf7cc215416c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:47.745188 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7acf483b-4548-4e52-9152-cf7cc215416c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:47.746499 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7acf483b-4548-4e52-9152-cf7cc215416c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:47.947051 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-7acf483b-4548-4e52-9152-cf7cc215416c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:47.963507 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-7acf483b-4548-4e52-9152-cf7cc215416c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:47.965178 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-7acf483b-4548-4e52-9152-cf7cc215416c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:47.966559 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-7acf483b-4548-4e52-9152-cf7cc215416c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1723 microversion: 2.20 time: 0.253127 Sep 01 14:08:47.967260 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 180/347] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:08:47 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:08:48.013675 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-a760715a-7815-4026-8567-4c9f4806209a tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:48.016804 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-a760715a-7815-4026-8567-4c9f4806209a tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 81fe7593-66bc-442e-bd42-67dbb727a356] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:48.032022 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a760715a-7815-4026-8567-4c9f4806209a tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:48.033157 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a760715a-7815-4026-8567-4c9f4806209a tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:48.034684 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a760715a-7815-4026-8567-4c9f4806209a tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:48.036575 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a760715a-7815-4026-8567-4c9f4806209a tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:48.037660 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a760715a-7815-4026-8567-4c9f4806209a tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:48.038625 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a760715a-7815-4026-8567-4c9f4806209a tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:48.154326 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-370512bf-dfe3-4d9d-a133-e94a82d179aa tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:48.162578 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-370512bf-dfe3-4d9d-a133-e94a82d179aa tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:48.203818 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-370512bf-dfe3-4d9d-a133-e94a82d179aa tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:48.204859 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-370512bf-dfe3-4d9d-a133-e94a82d179aa tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:48.207288 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-370512bf-dfe3-4d9d-a133-e94a82d179aa tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:48.208998 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-370512bf-dfe3-4d9d-a133-e94a82d179aa tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:48.210100 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-370512bf-dfe3-4d9d-a133-e94a82d179aa tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:48.211008 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-370512bf-dfe3-4d9d-a133-e94a82d179aa tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:48.260565 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-a760715a-7815-4026-8567-4c9f4806209a tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53d275b44a2432a9fe8611304bcfa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d998735c243c3bcd08ca2e2d81ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:48.279628 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-a760715a-7815-4026-8567-4c9f4806209a tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356" status: 200 len: 1223 microversion: 2.1 time: 0.277025 Sep 01 14:08:48.303020 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 168/348] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:47 2022] GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356 => generated 1223 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:48.369489 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-370512bf-dfe3-4d9d-a133-e94a82d179aa tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:48.386109 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-370512bf-dfe3-4d9d-a133-e94a82d179aa tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1297 microversion: 2.1 time: 0.249812 Sep 01 14:08:48.408113 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 181/349] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:48 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1297 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:48.422246 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-341b237a-b3b7-470b-b8ff-ad4689f11b2c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:48.423129 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-341b237a-b3b7-470b-b8ff-ad4689f11b2c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:48.480227 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-341b237a-b3b7-470b-b8ff-ad4689f11b2c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:48.482719 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-341b237a-b3b7-470b-b8ff-ad4689f11b2c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:48.485068 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-341b237a-b3b7-470b-b8ff-ad4689f11b2c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:48.493470 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-341b237a-b3b7-470b-b8ff-ad4689f11b2c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:48.495094 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-341b237a-b3b7-470b-b8ff-ad4689f11b2c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:48.501285 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-341b237a-b3b7-470b-b8ff-ad4689f11b2c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:48.779197 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [req-2d569051-76da-463b-83de-a59f46c47f9f req-af23d2b5-ccd1-47ed-b4eb-9da55a065061 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d39f7090-b419-46be-9fcc-7ae73004ab71", "name": "network-vif-unplugged", "status": "completed", "tag": "9ae4ab09-714c-4175-ba0d-7b76b31e652d"}]} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:08:48.834476 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-2d569051-76da-463b-83de-a59f46c47f9f req-af23d2b5-ccd1-47ed-b4eb-9da55a065061 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:48.835405 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-2d569051-76da-463b-83de-a59f46c47f9f req-af23d2b5-ccd1-47ed-b4eb-9da55a065061 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:48.837383 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-2d569051-76da-463b-83de-a59f46c47f9f req-af23d2b5-ccd1-47ed-b4eb-9da55a065061 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:48.872498 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.compute.server_external_events [req-2d569051-76da-463b-83de-a59f46c47f9f req-af23d2b5-ccd1-47ed-b4eb-9da55a065061 service nova] Creating event network-vif-unplugged:9ae4ab09-714c-4175-ba0d-7b76b31e652d for instance d39f7090-b419-46be-9fcc-7ae73004ab71 on hv-cinder-85221 Sep 01 14:08:48.886168 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [req-2d569051-76da-463b-83de-a59f46c47f9f req-af23d2b5-ccd1-47ed-b4eb-9da55a065061 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115185 Sep 01 14:08:48.888168 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 182/350] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:08:49.006484 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-4cc2c76b-254d-4bd6-8676-9e19822bf90d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:49.011608 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-4cc2c76b-254d-4bd6-8676-9e19822bf90d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:49.045343 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4cc2c76b-254d-4bd6-8676-9e19822bf90d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:49.050166 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4cc2c76b-254d-4bd6-8676-9e19822bf90d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:49.051253 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4cc2c76b-254d-4bd6-8676-9e19822bf90d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:49.054360 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4cc2c76b-254d-4bd6-8676-9e19822bf90d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:49.056204 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4cc2c76b-254d-4bd6-8676-9e19822bf90d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:49.057264 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4cc2c76b-254d-4bd6-8676-9e19822bf90d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:49.278458 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-341b237a-b3b7-470b-b8ff-ad4689f11b2c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:49.294378 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-341b237a-b3b7-470b-b8ff-ad4689f11b2c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1701 microversion: 2.1 time: 0.878796 Sep 01 14:08:49.297074 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 169/351] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:48 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1701 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:49.327998 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-b838c5ad-f92e-4d2e-928f-5e9bac386cac tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:49.327998 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-b838c5ad-f92e-4d2e-928f-5e9bac386cac tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 81fe7593-66bc-442e-bd42-67dbb727a356] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:49.339122 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b838c5ad-f92e-4d2e-928f-5e9bac386cac tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:49.351003 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b838c5ad-f92e-4d2e-928f-5e9bac386cac tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:49.351764 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b838c5ad-f92e-4d2e-928f-5e9bac386cac tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:49.352745 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b838c5ad-f92e-4d2e-928f-5e9bac386cac tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:49.355597 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b838c5ad-f92e-4d2e-928f-5e9bac386cac tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:49.366612 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b838c5ad-f92e-4d2e-928f-5e9bac386cac tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:49.542036 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-b838c5ad-f92e-4d2e-928f-5e9bac386cac tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53d275b44a2432a9fe8611304bcfa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d998735c243c3bcd08ca2e2d81ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:49.570565 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-b838c5ad-f92e-4d2e-928f-5e9bac386cac tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356" status: 200 len: 1215 microversion: 2.1 time: 0.249728 Sep 01 14:08:49.570565 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 170/352] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:49 2022] GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356 => generated 1215 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:49.570565 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-4e843ce9-e479-4a46-b9f2-a1574248f5b9 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:08:49.583699 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4e843ce9-e479-4a46-b9f2-a1574248f5b9 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:49.584238 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4e843ce9-e479-4a46-b9f2-a1574248f5b9 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:49.584555 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4e843ce9-e479-4a46-b9f2-a1574248f5b9 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:49.608891 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-4cc2c76b-254d-4bd6-8676-9e19822bf90d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:49.645411 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-4cc2c76b-254d-4bd6-8676-9e19822bf90d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:49.648074 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-4cc2c76b-254d-4bd6-8676-9e19822bf90d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:49.651659 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-4cc2c76b-254d-4bd6-8676-9e19822bf90d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1723 microversion: 2.20 time: 0.659865 Sep 01 14:08:49.662817 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 183/353] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:08:48 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1723 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:08:49.677131 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-13cdcd81-d5ff-4eef-a0de-d0133eb8259d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:49.678126 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-13cdcd81-d5ff-4eef-a0de-d0133eb8259d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:49.689777 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-13cdcd81-d5ff-4eef-a0de-d0133eb8259d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:49.694062 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-13cdcd81-d5ff-4eef-a0de-d0133eb8259d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:49.694885 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-13cdcd81-d5ff-4eef-a0de-d0133eb8259d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:49.697278 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-13cdcd81-d5ff-4eef-a0de-d0133eb8259d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:49.698298 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-13cdcd81-d5ff-4eef-a0de-d0133eb8259d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:49.699337 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-13cdcd81-d5ff-4eef-a0de-d0133eb8259d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:49.711612 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell1:SELECT=100 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:49.750490 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-4e843ce9-e479-4a46-b9f2-a1574248f5b9 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Going to try to start instance {{(pid=121339) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 01 14:08:49.842222 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-13cdcd81-d5ff-4eef-a0de-d0133eb8259d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:49.872030 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-13cdcd81-d5ff-4eef-a0de-d0133eb8259d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1303 microversion: 2.1 time: 0.207672 Sep 01 14:08:49.873807 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 184/354] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:49 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1303 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:50.113516 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-4e843ce9-e479-4a46-b9f2-a1574248f5b9 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "POST /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7/action" status: 202 len: 0 microversion: 2.1 time: 0.549751 Sep 01 14:08:50.115300 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 171/355] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Sep 1 14:08:49 2022] POST /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7/action => generated 0 bytes in 554 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:08:50.130588 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-bd87fe9b-9a80-4a67-8bb7-5297911b288d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:50.131393 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-bd87fe9b-9a80-4a67-8bb7-5297911b288d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:50.141611 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bd87fe9b-9a80-4a67-8bb7-5297911b288d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:50.148217 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bd87fe9b-9a80-4a67-8bb7-5297911b288d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:50.149656 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bd87fe9b-9a80-4a67-8bb7-5297911b288d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:50.150667 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bd87fe9b-9a80-4a67-8bb7-5297911b288d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:50.151243 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bd87fe9b-9a80-4a67-8bb7-5297911b288d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:50.157644 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bd87fe9b-9a80-4a67-8bb7-5297911b288d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:50.587461 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-974abe71-ac4d-4f47-ab58-91e654bd4b15 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:50.588860 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-974abe71-ac4d-4f47-ab58-91e654bd4b15 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 81fe7593-66bc-442e-bd42-67dbb727a356] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:50.608422 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-974abe71-ac4d-4f47-ab58-91e654bd4b15 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:50.613236 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-974abe71-ac4d-4f47-ab58-91e654bd4b15 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:50.614143 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-974abe71-ac4d-4f47-ab58-91e654bd4b15 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:50.615142 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-974abe71-ac4d-4f47-ab58-91e654bd4b15 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:50.615917 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-974abe71-ac4d-4f47-ab58-91e654bd4b15 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:50.616681 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-974abe71-ac4d-4f47-ab58-91e654bd4b15 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:50.789267 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-974abe71-ac4d-4f47-ab58-91e654bd4b15 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53d275b44a2432a9fe8611304bcfa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d998735c243c3bcd08ca2e2d81ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:50.821818 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-974abe71-ac4d-4f47-ab58-91e654bd4b15 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356" status: 200 len: 1271 microversion: 2.1 time: 0.239395 Sep 01 14:08:50.823197 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 172/356] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:50 2022] GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356 => generated 1271 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:08:50.841370 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-0a632746-b86a-4429-a5ac-8b53bb315d93 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:50.842037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-0a632746-b86a-4429-a5ac-8b53bb315d93 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:50.849484 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0a632746-b86a-4429-a5ac-8b53bb315d93 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:50.850046 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0a632746-b86a-4429-a5ac-8b53bb315d93 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:50.850483 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0a632746-b86a-4429-a5ac-8b53bb315d93 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:50.851221 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0a632746-b86a-4429-a5ac-8b53bb315d93 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:50.851653 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0a632746-b86a-4429-a5ac-8b53bb315d93 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:50.852071 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0a632746-b86a-4429-a5ac-8b53bb315d93 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:50.899903 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-bd87fe9b-9a80-4a67-8bb7-5297911b288d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:50.917479 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-bd87fe9b-9a80-4a67-8bb7-5297911b288d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1710 microversion: 2.1 time: 0.791594 Sep 01 14:08:50.918395 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 185/357] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:50 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1710 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:08:50.926306 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-3344c007-8b1c-426f-9cfd-f6df7bf0f773 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:50.927366 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-3344c007-8b1c-426f-9cfd-f6df7bf0f773 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:50.944692 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3344c007-8b1c-426f-9cfd-f6df7bf0f773 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:50.945195 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3344c007-8b1c-426f-9cfd-f6df7bf0f773 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:50.945634 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3344c007-8b1c-426f-9cfd-f6df7bf0f773 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:50.947570 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3344c007-8b1c-426f-9cfd-f6df7bf0f773 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:50.950696 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3344c007-8b1c-426f-9cfd-f6df7bf0f773 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:50.951279 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3344c007-8b1c-426f-9cfd-f6df7bf0f773 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:51.233635 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-3344c007-8b1c-426f-9cfd-f6df7bf0f773 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:51.264133 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-3344c007-8b1c-426f-9cfd-f6df7bf0f773 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1303 microversion: 2.1 time: 0.342278 Sep 01 14:08:51.266794 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 186/358] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:50 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1303 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:51.380195 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-0a632746-b86a-4429-a5ac-8b53bb315d93 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:51.429009 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-0a632746-b86a-4429-a5ac-8b53bb315d93 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:51.434041 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-0a632746-b86a-4429-a5ac-8b53bb315d93 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:51.454745 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-0a632746-b86a-4429-a5ac-8b53bb315d93 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1723 microversion: 2.20 time: 0.611906 Sep 01 14:08:51.475604 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 173/359] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:08:50 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1723 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:08:51.849237 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-ab55f89d-0255-474b-9fb8-87da600204fd tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:51.849835 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-ab55f89d-0255-474b-9fb8-87da600204fd tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 81fe7593-66bc-442e-bd42-67dbb727a356] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:51.867059 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ab55f89d-0255-474b-9fb8-87da600204fd tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:51.871161 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ab55f89d-0255-474b-9fb8-87da600204fd tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:51.872003 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ab55f89d-0255-474b-9fb8-87da600204fd tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:51.873327 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ab55f89d-0255-474b-9fb8-87da600204fd tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:51.874228 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ab55f89d-0255-474b-9fb8-87da600204fd tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:51.889810 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ab55f89d-0255-474b-9fb8-87da600204fd tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:51.963744 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-1f44a65a-c250-41c1-a94a-a5a082640b9d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:51.966997 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-1f44a65a-c250-41c1-a94a-a5a082640b9d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:51.991321 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1f44a65a-c250-41c1-a94a-a5a082640b9d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:51.992525 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1f44a65a-c250-41c1-a94a-a5a082640b9d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:51.994592 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1f44a65a-c250-41c1-a94a-a5a082640b9d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:51.996820 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1f44a65a-c250-41c1-a94a-a5a082640b9d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:52.010104 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1f44a65a-c250-41c1-a94a-a5a082640b9d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:52.011232 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1f44a65a-c250-41c1-a94a-a5a082640b9d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:52.131720 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-ab55f89d-0255-474b-9fb8-87da600204fd tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53d275b44a2432a9fe8611304bcfa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d998735c243c3bcd08ca2e2d81ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:52.185492 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-ab55f89d-0255-474b-9fb8-87da600204fd tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356" status: 200 len: 1271 microversion: 2.1 time: 0.343595 Sep 01 14:08:52.186642 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 187/360] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:51 2022] GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356 => generated 1271 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:52.295103 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-bebaf6e3-67db-474a-ba38-d04e78dc865f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:52.295822 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-bebaf6e3-67db-474a-ba38-d04e78dc865f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:52.303032 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bebaf6e3-67db-474a-ba38-d04e78dc865f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:52.303753 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bebaf6e3-67db-474a-ba38-d04e78dc865f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:52.304475 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bebaf6e3-67db-474a-ba38-d04e78dc865f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:52.305387 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bebaf6e3-67db-474a-ba38-d04e78dc865f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:52.307898 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bebaf6e3-67db-474a-ba38-d04e78dc865f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:52.308618 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bebaf6e3-67db-474a-ba38-d04e78dc865f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:52.352646 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-1f44a65a-c250-41c1-a94a-a5a082640b9d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:52.373737 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-1f44a65a-c250-41c1-a94a-a5a082640b9d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1710 microversion: 2.1 time: 0.421153 Sep 01 14:08:52.376633 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 174/361] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:51 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1710 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:52.497676 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-3894e4b2-1c3b-4b27-b453-caa74d37cbb6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:52.498748 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-3894e4b2-1c3b-4b27-b453-caa74d37cbb6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:52.506974 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3894e4b2-1c3b-4b27-b453-caa74d37cbb6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:52.508020 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3894e4b2-1c3b-4b27-b453-caa74d37cbb6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:52.509824 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3894e4b2-1c3b-4b27-b453-caa74d37cbb6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:52.510882 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3894e4b2-1c3b-4b27-b453-caa74d37cbb6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:52.511559 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3894e4b2-1c3b-4b27-b453-caa74d37cbb6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:52.512188 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3894e4b2-1c3b-4b27-b453-caa74d37cbb6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:52.638495 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell0:SELECT=2 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:52.763867 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-bebaf6e3-67db-474a-ba38-d04e78dc865f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:52.773763 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-bebaf6e3-67db-474a-ba38-d04e78dc865f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1371 microversion: 2.1 time: 0.482475 Sep 01 14:08:52.774375 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 188/362] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:52 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1371 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:08:52.914137 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-3894e4b2-1c3b-4b27-b453-caa74d37cbb6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:52.930293 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-3894e4b2-1c3b-4b27-b453-caa74d37cbb6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:52.935778 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-3894e4b2-1c3b-4b27-b453-caa74d37cbb6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:52.935778 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-3894e4b2-1c3b-4b27-b453-caa74d37cbb6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1723 microversion: 2.20 time: 0.441449 Sep 01 14:08:52.942806 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 175/363] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:08:52 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1723 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:08:53.218096 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-6b6dc8af-f7b5-4c96-b3af-51dee576acce tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:53.218806 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-6b6dc8af-f7b5-4c96-b3af-51dee576acce tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 81fe7593-66bc-442e-bd42-67dbb727a356] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:53.237171 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6b6dc8af-f7b5-4c96-b3af-51dee576acce tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:53.238558 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6b6dc8af-f7b5-4c96-b3af-51dee576acce tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:53.245260 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6b6dc8af-f7b5-4c96-b3af-51dee576acce tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:53.245260 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6b6dc8af-f7b5-4c96-b3af-51dee576acce tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:53.245260 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6b6dc8af-f7b5-4c96-b3af-51dee576acce tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:53.245818 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6b6dc8af-f7b5-4c96-b3af-51dee576acce tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:53.399630 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-db93053b-da63-458e-bd20-87e7e79c50e1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:53.400250 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-db93053b-da63-458e-bd20-87e7e79c50e1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:53.412079 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-6b6dc8af-f7b5-4c96-b3af-51dee576acce tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53d275b44a2432a9fe8611304bcfa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d998735c243c3bcd08ca2e2d81ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:53.412582 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-db93053b-da63-458e-bd20-87e7e79c50e1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:53.414753 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-db93053b-da63-458e-bd20-87e7e79c50e1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:53.416441 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-db93053b-da63-458e-bd20-87e7e79c50e1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:53.417644 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-db93053b-da63-458e-bd20-87e7e79c50e1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:53.420508 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-db93053b-da63-458e-bd20-87e7e79c50e1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:53.421508 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-db93053b-da63-458e-bd20-87e7e79c50e1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:53.427659 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-6b6dc8af-f7b5-4c96-b3af-51dee576acce tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356" status: 200 len: 1271 microversion: 2.1 time: 0.218315 Sep 01 14:08:53.428334 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 189/364] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:53 2022] GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356 => generated 1271 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:53.673395 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-db93053b-da63-458e-bd20-87e7e79c50e1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:53.686921 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-db93053b-da63-458e-bd20-87e7e79c50e1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1710 microversion: 2.1 time: 0.291739 Sep 01 14:08:53.695145 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 176/365] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:53 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1710 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:53.798033 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-b77f474e-6cca-44f5-804b-431fd2f8a707 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:53.799697 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-b77f474e-6cca-44f5-804b-431fd2f8a707 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:53.809315 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b77f474e-6cca-44f5-804b-431fd2f8a707 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:53.810147 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b77f474e-6cca-44f5-804b-431fd2f8a707 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:53.817645 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b77f474e-6cca-44f5-804b-431fd2f8a707 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:53.817645 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b77f474e-6cca-44f5-804b-431fd2f8a707 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:53.817645 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b77f474e-6cca-44f5-804b-431fd2f8a707 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:53.817645 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b77f474e-6cca-44f5-804b-431fd2f8a707 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:53.958787 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-29d254d5-f046-48be-96d5-1f8f9397a00b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:53.959674 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-29d254d5-f046-48be-96d5-1f8f9397a00b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:53.976250 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-29d254d5-f046-48be-96d5-1f8f9397a00b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:53.977771 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-29d254d5-f046-48be-96d5-1f8f9397a00b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:53.978446 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-29d254d5-f046-48be-96d5-1f8f9397a00b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:53.979387 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-29d254d5-f046-48be-96d5-1f8f9397a00b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:53.980020 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-29d254d5-f046-48be-96d5-1f8f9397a00b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:53.980620 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-29d254d5-f046-48be-96d5-1f8f9397a00b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:54.423546 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-b77f474e-6cca-44f5-804b-431fd2f8a707 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:54.442341 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-b77f474e-6cca-44f5-804b-431fd2f8a707 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1371 microversion: 2.1 time: 0.649126 Sep 01 14:08:54.451201 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 190/366] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:53 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1371 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:54.468751 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-bd0a4f21-6aaf-4fae-9ce7-35f2a7be3157 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:54.482954 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-bd0a4f21-6aaf-4fae-9ce7-35f2a7be3157 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 81fe7593-66bc-442e-bd42-67dbb727a356] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:54.483593 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell0:SELECT=12 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:54.499754 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bd0a4f21-6aaf-4fae-9ce7-35f2a7be3157 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:54.500988 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bd0a4f21-6aaf-4fae-9ce7-35f2a7be3157 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:54.502096 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bd0a4f21-6aaf-4fae-9ce7-35f2a7be3157 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:54.503649 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bd0a4f21-6aaf-4fae-9ce7-35f2a7be3157 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:54.504702 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bd0a4f21-6aaf-4fae-9ce7-35f2a7be3157 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:54.505673 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bd0a4f21-6aaf-4fae-9ce7-35f2a7be3157 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:54.528490 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-29d254d5-f046-48be-96d5-1f8f9397a00b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:54.542284 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-29d254d5-f046-48be-96d5-1f8f9397a00b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:54.545953 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-29d254d5-f046-48be-96d5-1f8f9397a00b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:54.551866 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-29d254d5-f046-48be-96d5-1f8f9397a00b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1726 microversion: 2.20 time: 0.598799 Sep 01 14:08:54.552472 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 177/367] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:08:53 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1726 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:08:54.576325 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-2ce07624-7c9c-4ad1-bb21-c3fbc7c10ea1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "92ffabaa-1bd2-463b-a43e-04de46cdded6"}} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:08:54.581030 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-2ce07624-7c9c-4ad1-bb21-c3fbc7c10ea1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:54.589445 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2ce07624-7c9c-4ad1-bb21-c3fbc7c10ea1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:54.590221 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2ce07624-7c9c-4ad1-bb21-c3fbc7c10ea1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:54.590827 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2ce07624-7c9c-4ad1-bb21-c3fbc7c10ea1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:54.591899 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2ce07624-7c9c-4ad1-bb21-c3fbc7c10ea1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:54.592594 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2ce07624-7c9c-4ad1-bb21-c3fbc7c10ea1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:54.593216 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2ce07624-7c9c-4ad1-bb21-c3fbc7c10ea1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:54.644848 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-bd0a4f21-6aaf-4fae-9ce7-35f2a7be3157 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53d275b44a2432a9fe8611304bcfa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d998735c243c3bcd08ca2e2d81ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:54.656490 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-bd0a4f21-6aaf-4fae-9ce7-35f2a7be3157 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356" status: 200 len: 1289 microversion: 2.1 time: 0.194370 Sep 01 14:08:54.657488 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 191/368] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:54 2022] GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356 => generated 1289 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:08:54.731561 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-1918bf5a-0ca1-4e4d-a901-42ff1f1aa7d7 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:54.731561 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-1918bf5a-0ca1-4e4d-a901-42ff1f1aa7d7 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:54.738676 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1918bf5a-0ca1-4e4d-a901-42ff1f1aa7d7 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:54.739418 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1918bf5a-0ca1-4e4d-a901-42ff1f1aa7d7 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:54.739960 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1918bf5a-0ca1-4e4d-a901-42ff1f1aa7d7 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:54.740801 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1918bf5a-0ca1-4e4d-a901-42ff1f1aa7d7 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:54.741370 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1918bf5a-0ca1-4e4d-a901-42ff1f1aa7d7 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:54.741809 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1918bf5a-0ca1-4e4d-a901-42ff1f1aa7d7 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:55.033427 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-1918bf5a-0ca1-4e4d-a901-42ff1f1aa7d7 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:55.110872 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-1918bf5a-0ca1-4e4d-a901-42ff1f1aa7d7 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1710 microversion: 2.1 time: 0.401383 Sep 01 14:08:55.114312 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 192/369] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:54 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1710 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:08:55.126196 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [req-1f8a5ae1-ecde-4eb4-b2a8-a87bcaf6e658 req-b35aed51-1eb1-4eb1-a1f9-b4cae1624e4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1988647a-695e-49b8-a5d3-dd6c93c10ae5", "tag": "f27eab44-1c4b-4c5c-95ab-4dbdc5728861"}]} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:08:55.145875 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-1f8a5ae1-ecde-4eb4-b2a8-a87bcaf6e658 req-b35aed51-1eb1-4eb1-a1f9-b4cae1624e4d service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:55.154296 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-1f8a5ae1-ecde-4eb4-b2a8-a87bcaf6e658 req-b35aed51-1eb1-4eb1-a1f9-b4cae1624e4d service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:55.154296 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-1f8a5ae1-ecde-4eb4-b2a8-a87bcaf6e658 req-b35aed51-1eb1-4eb1-a1f9-b4cae1624e4d service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:55.186332 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.compute.server_external_events [req-1f8a5ae1-ecde-4eb4-b2a8-a87bcaf6e658 req-b35aed51-1eb1-4eb1-a1f9-b4cae1624e4d service nova] Creating event network-changed:f27eab44-1c4b-4c5c-95ab-4dbdc5728861 for instance 1988647a-695e-49b8-a5d3-dd6c93c10ae5 on hv-cinder-85221 Sep 01 14:08:55.200081 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [req-1f8a5ae1-ecde-4eb4-b2a8-a87bcaf6e658 req-b35aed51-1eb1-4eb1-a1f9-b4cae1624e4d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082730 Sep 01 14:08:55.205774 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 193/370] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:08:55.476923 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-3eef8e59-6a00-48d9-b7fb-42d17cdeeead tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:55.477736 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-3eef8e59-6a00-48d9-b7fb-42d17cdeeead tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:55.484427 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3eef8e59-6a00-48d9-b7fb-42d17cdeeead tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:55.485171 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3eef8e59-6a00-48d9-b7fb-42d17cdeeead tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:55.485625 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3eef8e59-6a00-48d9-b7fb-42d17cdeeead tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:55.486413 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3eef8e59-6a00-48d9-b7fb-42d17cdeeead tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:55.488245 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3eef8e59-6a00-48d9-b7fb-42d17cdeeead tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:55.488245 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3eef8e59-6a00-48d9-b7fb-42d17cdeeead tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:56.043728 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-3eef8e59-6a00-48d9-b7fb-42d17cdeeead tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:56.055689 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-3eef8e59-6a00-48d9-b7fb-42d17cdeeead tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1371 microversion: 2.1 time: 0.585037 Sep 01 14:08:56.058289 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 194/371] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:55 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1371 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:08:56.085987 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-bceca566-8385-403b-b2be-f2508002943a tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:56.085987 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-bceca566-8385-403b-b2be-f2508002943a tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 81fe7593-66bc-442e-bd42-67dbb727a356] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:56.097845 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bceca566-8385-403b-b2be-f2508002943a tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:56.099220 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bceca566-8385-403b-b2be-f2508002943a tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:56.099998 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bceca566-8385-403b-b2be-f2508002943a tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:56.101279 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bceca566-8385-403b-b2be-f2508002943a tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:56.103077 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bceca566-8385-403b-b2be-f2508002943a tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:56.103863 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bceca566-8385-403b-b2be-f2508002943a tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:56.381046 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:56.485724 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-bceca566-8385-403b-b2be-f2508002943a tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53d275b44a2432a9fe8611304bcfa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d998735c243c3bcd08ca2e2d81ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:56.494572 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-bceca566-8385-403b-b2be-f2508002943a tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356" status: 200 len: 1319 microversion: 2.1 time: 0.434920 Sep 01 14:08:56.495170 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 195/372] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:56 2022] GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356 => generated 1319 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:56.500415 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-8b99d971-b1cd-492f-841f-3559e6397803 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:56.501038 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-8b99d971-b1cd-492f-841f-3559e6397803 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:56.508247 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8b99d971-b1cd-492f-841f-3559e6397803 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:56.508777 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8b99d971-b1cd-492f-841f-3559e6397803 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:56.509218 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8b99d971-b1cd-492f-841f-3559e6397803 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:56.509959 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8b99d971-b1cd-492f-841f-3559e6397803 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:56.510424 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8b99d971-b1cd-492f-841f-3559e6397803 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:56.510852 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8b99d971-b1cd-492f-841f-3559e6397803 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:56.526997 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-2ce07624-7c9c-4ad1-bb21-c3fbc7c10ea1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "POST /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.955153 Sep 01 14:08:56.529935 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 178/373] 10.222.0.25 () {62 vars in 1364 bytes} [Thu Sep 1 14:08:54 2022] POST /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71/os-volume_attachments => generated 188 bytes in 1957 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 14:08:56.787963 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-57a53b8c-9ac7-423f-8c6d-03dba0c5e013 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:08:56.801117 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-57a53b8c-9ac7-423f-8c6d-03dba0c5e013 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:56.816755 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-57a53b8c-9ac7-423f-8c6d-03dba0c5e013 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:56.817823 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-57a53b8c-9ac7-423f-8c6d-03dba0c5e013 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:56.826403 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-57a53b8c-9ac7-423f-8c6d-03dba0c5e013 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:56.827952 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-57a53b8c-9ac7-423f-8c6d-03dba0c5e013 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:56.829383 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-57a53b8c-9ac7-423f-8c6d-03dba0c5e013 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:56.830867 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-57a53b8c-9ac7-423f-8c6d-03dba0c5e013 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:56.994804 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-57a53b8c-9ac7-423f-8c6d-03dba0c5e013 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121339) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 01 14:08:57.046883 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-8b99d971-b1cd-492f-841f-3559e6397803 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:57.064012 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-8b99d971-b1cd-492f-841f-3559e6397803 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1714 microversion: 2.1 time: 0.567440 Sep 01 14:08:57.065662 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 196/374] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:56 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1714 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:57.083639 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-9dbd8b6d-cca1-46fa-baa5-41486fb41d17 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:57.084757 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-9dbd8b6d-cca1-46fa-baa5-41486fb41d17 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:57.091336 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9dbd8b6d-cca1-46fa-baa5-41486fb41d17 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:57.091931 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9dbd8b6d-cca1-46fa-baa5-41486fb41d17 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:57.092476 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9dbd8b6d-cca1-46fa-baa5-41486fb41d17 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:57.093263 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9dbd8b6d-cca1-46fa-baa5-41486fb41d17 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:57.093805 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9dbd8b6d-cca1-46fa-baa5-41486fb41d17 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:57.094405 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9dbd8b6d-cca1-46fa-baa5-41486fb41d17 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:57.668064 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-57a53b8c-9ac7-423f-8c6d-03dba0c5e013 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "POST /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71/action" status: 202 len: 0 microversion: 2.20 time: 0.887170 Sep 01 14:08:57.671935 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 179/375] 10.222.0.25 () {62 vars in 1319 bytes} [Thu Sep 1 14:08:56 2022] POST /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71/action => generated 0 bytes in 892 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:08:57.701547 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-1f6931fd-f8c5-4a5f-819f-43e14d5c12ae tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:57.703493 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-1f6931fd-f8c5-4a5f-819f-43e14d5c12ae tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 81fe7593-66bc-442e-bd42-67dbb727a356] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:57.719164 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1f6931fd-f8c5-4a5f-819f-43e14d5c12ae tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:57.720436 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1f6931fd-f8c5-4a5f-819f-43e14d5c12ae tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:57.721611 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1f6931fd-f8c5-4a5f-819f-43e14d5c12ae tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:57.723314 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1f6931fd-f8c5-4a5f-819f-43e14d5c12ae tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:57.724344 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1f6931fd-f8c5-4a5f-819f-43e14d5c12ae tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:57.725578 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1f6931fd-f8c5-4a5f-819f-43e14d5c12ae tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:57.835183 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-9dbd8b6d-cca1-46fa-baa5-41486fb41d17 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:57.864516 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-9dbd8b6d-cca1-46fa-baa5-41486fb41d17 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1371 microversion: 2.1 time: 0.784771 Sep 01 14:08:57.867230 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 197/376] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:57 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1371 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:57.889418 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-dd3f2e41-03df-4e82-9ccb-b76131922c5b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:57.891165 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-dd3f2e41-03df-4e82-9ccb-b76131922c5b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:57.909437 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-dd3f2e41-03df-4e82-9ccb-b76131922c5b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:57.911924 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-dd3f2e41-03df-4e82-9ccb-b76131922c5b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:57.917103 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-dd3f2e41-03df-4e82-9ccb-b76131922c5b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:57.917103 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-dd3f2e41-03df-4e82-9ccb-b76131922c5b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:57.917103 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-dd3f2e41-03df-4e82-9ccb-b76131922c5b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:57.917103 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-dd3f2e41-03df-4e82-9ccb-b76131922c5b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:58.238045 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-1f6931fd-f8c5-4a5f-819f-43e14d5c12ae tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53d275b44a2432a9fe8611304bcfa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d998735c243c3bcd08ca2e2d81ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:58.272936 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-1f6931fd-f8c5-4a5f-819f-43e14d5c12ae tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356" status: 200 len: 1319 microversion: 2.1 time: 0.588147 Sep 01 14:08:58.272936 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 180/377] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:57 2022] GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356 => generated 1319 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:58.288023 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-dd3f2e41-03df-4e82-9ccb-b76131922c5b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:58.291170 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [req-aa1c5c2b-dc99-4855-8012-d89da646983d req-f1011d55-0b75-42c6-9018-f06cc3ffda32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81fe7593-66bc-442e-bd42-67dbb727a356", "tag": "cbd0d6ee-8ef6-4903-9342-88e28ddb8597"}]} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:08:58.305525 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-dd3f2e41-03df-4e82-9ccb-b76131922c5b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:58.310636 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-dd3f2e41-03df-4e82-9ccb-b76131922c5b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:58.315607 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-aa1c5c2b-dc99-4855-8012-d89da646983d req-f1011d55-0b75-42c6-9018-f06cc3ffda32 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:58.316212 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-dd3f2e41-03df-4e82-9ccb-b76131922c5b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1752 microversion: 2.20 time: 0.442976 Sep 01 14:08:58.316910 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-aa1c5c2b-dc99-4855-8012-d89da646983d req-f1011d55-0b75-42c6-9018-f06cc3ffda32 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:58.317075 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 198/378] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:08:57 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1752 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:08:58.318087 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-aa1c5c2b-dc99-4855-8012-d89da646983d req-f1011d55-0b75-42c6-9018-f06cc3ffda32 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:58.355683 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.compute.server_external_events [req-aa1c5c2b-dc99-4855-8012-d89da646983d req-f1011d55-0b75-42c6-9018-f06cc3ffda32 service nova] Creating event network-changed:cbd0d6ee-8ef6-4903-9342-88e28ddb8597 for instance 81fe7593-66bc-442e-bd42-67dbb727a356 on hv-cinder-85221 Sep 01 14:08:58.374653 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [req-aa1c5c2b-dc99-4855-8012-d89da646983d req-f1011d55-0b75-42c6-9018-f06cc3ffda32 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104218 Sep 01 14:08:58.378398 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 181/379] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:08:58.889593 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-84cd241e-396c-4d7b-96d0-d6f265421950 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:58.889593 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-84cd241e-396c-4d7b-96d0-d6f265421950 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:58.899134 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-84cd241e-396c-4d7b-96d0-d6f265421950 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:58.899338 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-84cd241e-396c-4d7b-96d0-d6f265421950 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:58.899939 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-84cd241e-396c-4d7b-96d0-d6f265421950 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:58.901026 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-84cd241e-396c-4d7b-96d0-d6f265421950 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:58.901509 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-84cd241e-396c-4d7b-96d0-d6f265421950 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:58.901944 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-84cd241e-396c-4d7b-96d0-d6f265421950 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:59.204868 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-84cd241e-396c-4d7b-96d0-d6f265421950 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:59.240972 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-84cd241e-396c-4d7b-96d0-d6f265421950 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1371 microversion: 2.1 time: 0.355459 Sep 01 14:08:59.245429 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 199/380] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:58 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1371 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:08:59.298148 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-746e0c8d-7367-4c5c-aa68-7737633070e6 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:59.299538 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-746e0c8d-7367-4c5c-aa68-7737633070e6 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 81fe7593-66bc-442e-bd42-67dbb727a356] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:59.325962 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-746e0c8d-7367-4c5c-aa68-7737633070e6 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:59.332652 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-746e0c8d-7367-4c5c-aa68-7737633070e6 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:59.333466 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-746e0c8d-7367-4c5c-aa68-7737633070e6 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:59.338954 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-746e0c8d-7367-4c5c-aa68-7737633070e6 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:59.339800 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-746e0c8d-7367-4c5c-aa68-7737633070e6 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:59.340587 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-746e0c8d-7367-4c5c-aa68-7737633070e6 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:59.370875 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-63f6c492-cafd-4ae9-ad49-c7d0ad8405c1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:59.372022 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-63f6c492-cafd-4ae9-ad49-c7d0ad8405c1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:59.404845 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-63f6c492-cafd-4ae9-ad49-c7d0ad8405c1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:59.405372 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-63f6c492-cafd-4ae9-ad49-c7d0ad8405c1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:59.406205 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-63f6c492-cafd-4ae9-ad49-c7d0ad8405c1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:59.407927 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-63f6c492-cafd-4ae9-ad49-c7d0ad8405c1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:59.409194 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-63f6c492-cafd-4ae9-ad49-c7d0ad8405c1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:59.411514 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-63f6c492-cafd-4ae9-ad49-c7d0ad8405c1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:59.989811 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-746e0c8d-7367-4c5c-aa68-7737633070e6 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53d275b44a2432a9fe8611304bcfa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d998735c243c3bcd08ca2e2d81ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:59.996691 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-63f6c492-cafd-4ae9-ad49-c7d0ad8405c1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:00.020135 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-63f6c492-cafd-4ae9-ad49-c7d0ad8405c1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:00.026377 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-63f6c492-cafd-4ae9-ad49-c7d0ad8405c1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:00.028834 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-63f6c492-cafd-4ae9-ad49-c7d0ad8405c1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1752 microversion: 2.20 time: 0.665846 Sep 01 14:09:00.030280 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 200/381] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:08:59 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1752 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:09:00.031019 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-746e0c8d-7367-4c5c-aa68-7737633070e6 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356" status: 200 len: 1319 microversion: 2.1 time: 0.734977 Sep 01 14:09:00.032989 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 182/382] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:59 2022] GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356 => generated 1319 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:09:00.292690 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-562bccce-4c03-4c46-804e-254969dc5a4d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:00.292690 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-562bccce-4c03-4c46-804e-254969dc5a4d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:00.308295 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-562bccce-4c03-4c46-804e-254969dc5a4d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:00.310737 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-562bccce-4c03-4c46-804e-254969dc5a4d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:00.311859 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-562bccce-4c03-4c46-804e-254969dc5a4d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:00.313540 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-562bccce-4c03-4c46-804e-254969dc5a4d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:00.315002 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-562bccce-4c03-4c46-804e-254969dc5a4d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:00.316702 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-562bccce-4c03-4c46-804e-254969dc5a4d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:00.368399 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell1:SELECT=100 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:00.604127 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-562bccce-4c03-4c46-804e-254969dc5a4d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:00.669286 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-562bccce-4c03-4c46-804e-254969dc5a4d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1371 microversion: 2.1 time: 0.403188 Sep 01 14:09:00.670384 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 201/383] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:00 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1371 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:01.012876 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-ff69306a-4283-4bcf-9f8c-586ef090ded2 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Action: 'create', calling method: .version_select at 0x7f9867d46ee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1433320455", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKk53junPmVZAWwy4pMBU4D70cH7xZCt7ElxbAct1xkoxKfhWOF3fYhtW/1SrMxTJZOeeFIszskC5FpeQXqm1bUDMe6DEqEVbpCrsj3sEwEdr8vWDd1WNKmMiS29DUMD+g=="}} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:09:01.045656 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.quota [None req-ff69306a-4283-4bcf-9f8c-586ef090ded2 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Getting quotas for project c1c061b824cb4a92a469061e7a67f967. Resources: {'key_pairs'} {{(pid=121339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:09:01.054032 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.quota [None req-ff69306a-4283-4bcf-9f8c-586ef090ded2 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Getting quotas for user af1f81b83784472abc4b6ff4393afb7c and project c1c061b824cb4a92a469061e7a67f967. Resources: {'key_pairs'} {{(pid=121339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:09:01.070278 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-5294898c-a6bb-4b27-8281-55fa86f0328f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:01.071005 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-5294898c-a6bb-4b27-8281-55fa86f0328f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:01.080157 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:01.087948 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5294898c-a6bb-4b27-8281-55fa86f0328f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:01.089354 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5294898c-a6bb-4b27-8281-55fa86f0328f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:01.093003 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5294898c-a6bb-4b27-8281-55fa86f0328f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:01.093003 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5294898c-a6bb-4b27-8281-55fa86f0328f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:01.093955 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5294898c-a6bb-4b27-8281-55fa86f0328f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:01.094688 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5294898c-a6bb-4b27-8281-55fa86f0328f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:01.298601 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-ff69306a-4283-4bcf-9f8c-586ef090ded2 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.582594 Sep 01 14:09:01.300729 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 183/384] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Sep 1 14:09:00 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:09:01.313430 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-25cbc839-09d2-40c6-bc94-2cd1c5eae2a1 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:01.315139 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-25cbc839-09d2-40c6-bc94-2cd1c5eae2a1 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 81fe7593-66bc-442e-bd42-67dbb727a356] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:01.352179 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-25cbc839-09d2-40c6-bc94-2cd1c5eae2a1 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:01.353065 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-25cbc839-09d2-40c6-bc94-2cd1c5eae2a1 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:01.353855 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-25cbc839-09d2-40c6-bc94-2cd1c5eae2a1 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:01.363680 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-25cbc839-09d2-40c6-bc94-2cd1c5eae2a1 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:01.364560 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-25cbc839-09d2-40c6-bc94-2cd1c5eae2a1 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:01.365368 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-25cbc839-09d2-40c6-bc94-2cd1c5eae2a1 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:01.381161 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-5294898c-a6bb-4b27-8281-55fa86f0328f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:01.393746 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-5294898c-a6bb-4b27-8281-55fa86f0328f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:01.396974 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-5294898c-a6bb-4b27-8281-55fa86f0328f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:01.398553 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-5294898c-a6bb-4b27-8281-55fa86f0328f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1752 microversion: 2.20 time: 0.335302 Sep 01 14:09:01.399889 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 202/385] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:09:01 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1752 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:09:01.709419 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-744f53c2-d075-4edd-83b6-321081dafa4d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:01.710390 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-744f53c2-d075-4edd-83b6-321081dafa4d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:01.729309 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-744f53c2-d075-4edd-83b6-321081dafa4d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:01.730791 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-744f53c2-d075-4edd-83b6-321081dafa4d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:01.731677 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-744f53c2-d075-4edd-83b6-321081dafa4d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:01.739412 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-744f53c2-d075-4edd-83b6-321081dafa4d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:01.740556 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-744f53c2-d075-4edd-83b6-321081dafa4d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:01.741758 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-744f53c2-d075-4edd-83b6-321081dafa4d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:01.764394 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-25cbc839-09d2-40c6-bc94-2cd1c5eae2a1 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53d275b44a2432a9fe8611304bcfa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d998735c243c3bcd08ca2e2d81ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:01.804144 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-25cbc839-09d2-40c6-bc94-2cd1c5eae2a1 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356" status: 200 len: 1319 microversion: 2.1 time: 0.499114 Sep 01 14:09:01.806476 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 184/386] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:01 2022] GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356 => generated 1319 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:02.178524 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-744f53c2-d075-4edd-83b6-321081dafa4d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:02.194317 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-744f53c2-d075-4edd-83b6-321081dafa4d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1371 microversion: 2.1 time: 0.488641 Sep 01 14:09:02.194496 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 203/387] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:01 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1371 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:09:02.428595 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-f09d6a9d-d4c7-4b0a-be88-4ff4f9729d4e tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:02.429505 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-f09d6a9d-d4c7-4b0a-be88-4ff4f9729d4e tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:02.436646 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f09d6a9d-d4c7-4b0a-be88-4ff4f9729d4e tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:02.437215 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f09d6a9d-d4c7-4b0a-be88-4ff4f9729d4e tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:02.437735 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f09d6a9d-d4c7-4b0a-be88-4ff4f9729d4e tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:02.438432 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f09d6a9d-d4c7-4b0a-be88-4ff4f9729d4e tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:02.439156 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f09d6a9d-d4c7-4b0a-be88-4ff4f9729d4e tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:02.440603 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f09d6a9d-d4c7-4b0a-be88-4ff4f9729d4e tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:02.719640 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-f09d6a9d-d4c7-4b0a-be88-4ff4f9729d4e tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:02.739232 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-f09d6a9d-d4c7-4b0a-be88-4ff4f9729d4e tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:02.741000 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-f09d6a9d-d4c7-4b0a-be88-4ff4f9729d4e tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:02.742543 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-f09d6a9d-d4c7-4b0a-be88-4ff4f9729d4e tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1754 microversion: 2.20 time: 0.319195 Sep 01 14:09:02.743604 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 185/388] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:09:02 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1754 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:09:02.839573 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-37a218e6-1fe9-467b-bda1-7fedb0ee8a32 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:02.840390 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-37a218e6-1fe9-467b-bda1-7fedb0ee8a32 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 81fe7593-66bc-442e-bd42-67dbb727a356] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:02.847589 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-37a218e6-1fe9-467b-bda1-7fedb0ee8a32 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:02.848091 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-37a218e6-1fe9-467b-bda1-7fedb0ee8a32 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:02.848533 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-37a218e6-1fe9-467b-bda1-7fedb0ee8a32 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:02.849293 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-37a218e6-1fe9-467b-bda1-7fedb0ee8a32 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:02.849752 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-37a218e6-1fe9-467b-bda1-7fedb0ee8a32 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:02.850505 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-37a218e6-1fe9-467b-bda1-7fedb0ee8a32 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:03.062889 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-37a218e6-1fe9-467b-bda1-7fedb0ee8a32 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53d275b44a2432a9fe8611304bcfa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d998735c243c3bcd08ca2e2d81ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:03.073028 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-37a218e6-1fe9-467b-bda1-7fedb0ee8a32 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356" status: 200 len: 1319 microversion: 2.1 time: 0.237637 Sep 01 14:09:03.086494 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 204/389] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:02 2022] GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356 => generated 1319 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:03.258981 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-29366d1c-6b80-42eb-9b1f-d4fe3a470dea tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:03.260517 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-29366d1c-6b80-42eb-9b1f-d4fe3a470dea tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:03.272179 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-29366d1c-6b80-42eb-9b1f-d4fe3a470dea tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:03.273759 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-29366d1c-6b80-42eb-9b1f-d4fe3a470dea tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:03.273759 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-29366d1c-6b80-42eb-9b1f-d4fe3a470dea tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:03.275442 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-29366d1c-6b80-42eb-9b1f-d4fe3a470dea tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:03.276188 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-29366d1c-6b80-42eb-9b1f-d4fe3a470dea tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:03.277443 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-29366d1c-6b80-42eb-9b1f-d4fe3a470dea tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:03.607837 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-29366d1c-6b80-42eb-9b1f-d4fe3a470dea tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:03.629718 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-29366d1c-6b80-42eb-9b1f-d4fe3a470dea tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1371 microversion: 2.1 time: 0.405063 Sep 01 14:09:03.630505 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 186/390] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:03 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1371 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:03.780081 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-33456c68-eb41-489f-ab9f-6b39524d1b14 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:03.782526 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-33456c68-eb41-489f-ab9f-6b39524d1b14 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:03.801793 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-33456c68-eb41-489f-ab9f-6b39524d1b14 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:03.803277 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-33456c68-eb41-489f-ab9f-6b39524d1b14 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:03.804523 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-33456c68-eb41-489f-ab9f-6b39524d1b14 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:03.806716 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-33456c68-eb41-489f-ab9f-6b39524d1b14 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:03.807978 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-33456c68-eb41-489f-ab9f-6b39524d1b14 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:03.809094 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-33456c68-eb41-489f-ab9f-6b39524d1b14 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:03.834513 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [req-40cdb72e-766f-46eb-9b0d-a25ed3036be4 req-e008af65-d22e-4d29-a821-8395542f9688 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1988647a-695e-49b8-a5d3-dd6c93c10ae5", "name": "network-vif-plugged", "status": "completed", "tag": "f27eab44-1c4b-4c5c-95ab-4dbdc5728861"}]} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:09:03.856177 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-40cdb72e-766f-46eb-9b0d-a25ed3036be4 req-e008af65-d22e-4d29-a821-8395542f9688 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:03.857961 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-40cdb72e-766f-46eb-9b0d-a25ed3036be4 req-e008af65-d22e-4d29-a821-8395542f9688 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:03.858772 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-40cdb72e-766f-46eb-9b0d-a25ed3036be4 req-e008af65-d22e-4d29-a821-8395542f9688 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:03.883276 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.compute.server_external_events [req-40cdb72e-766f-46eb-9b0d-a25ed3036be4 req-e008af65-d22e-4d29-a821-8395542f9688 service nova] Creating event network-vif-plugged:f27eab44-1c4b-4c5c-95ab-4dbdc5728861 for instance 1988647a-695e-49b8-a5d3-dd6c93c10ae5 on hv-cinder-85221 Sep 01 14:09:03.894753 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [req-40cdb72e-766f-46eb-9b0d-a25ed3036be4 req-e008af65-d22e-4d29-a821-8395542f9688 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066666 Sep 01 14:09:03.895894 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 187/391] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:09:04.098010 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-0ad59cfe-811b-44a4-bc48-830ec21d2b54 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:04.098799 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-0ad59cfe-811b-44a4-bc48-830ec21d2b54 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 81fe7593-66bc-442e-bd42-67dbb727a356] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:04.112542 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0ad59cfe-811b-44a4-bc48-830ec21d2b54 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:04.113589 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0ad59cfe-811b-44a4-bc48-830ec21d2b54 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:04.114309 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0ad59cfe-811b-44a4-bc48-830ec21d2b54 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:04.115967 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0ad59cfe-811b-44a4-bc48-830ec21d2b54 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:04.116637 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0ad59cfe-811b-44a4-bc48-830ec21d2b54 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:04.117252 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0ad59cfe-811b-44a4-bc48-830ec21d2b54 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:04.149775 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-33456c68-eb41-489f-ab9f-6b39524d1b14 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:04.177483 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-33456c68-eb41-489f-ab9f-6b39524d1b14 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:04.184540 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-33456c68-eb41-489f-ab9f-6b39524d1b14 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:04.185857 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-33456c68-eb41-489f-ab9f-6b39524d1b14 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1754 microversion: 2.20 time: 0.414897 Sep 01 14:09:04.195216 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 205/392] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:09:03 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1754 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:09:04.400933 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-0ad59cfe-811b-44a4-bc48-830ec21d2b54 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53d275b44a2432a9fe8611304bcfa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d998735c243c3bcd08ca2e2d81ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:04.412741 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-0ad59cfe-811b-44a4-bc48-830ec21d2b54 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356" status: 200 len: 1319 microversion: 2.1 time: 0.320140 Sep 01 14:09:04.413806 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 188/393] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:04 2022] GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356 => generated 1319 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:09:04.483095 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-6d6906f8-5b49-4635-8ca5-46081ad9e628 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:04.484651 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-6d6906f8-5b49-4635-8ca5-46081ad9e628 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 91814986-adf4-46cb-8edf-820106d37ecb] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:04.505423 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6d6906f8-5b49-4635-8ca5-46081ad9e628 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:04.506204 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6d6906f8-5b49-4635-8ca5-46081ad9e628 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:04.506912 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6d6906f8-5b49-4635-8ca5-46081ad9e628 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:04.518232 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6d6906f8-5b49-4635-8ca5-46081ad9e628 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:04.519843 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6d6906f8-5b49-4635-8ca5-46081ad9e628 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:04.520561 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6d6906f8-5b49-4635-8ca5-46081ad9e628 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:04.597370 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-6d6906f8-5b49-4635-8ca5-46081ad9e628 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb/ips" status: 200 len: 151 microversion: 2.1 time: 0.126711 Sep 01 14:09:04.599322 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 206/394] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Sep 1 14:09:04 2022] GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb/ips => generated 151 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:09:04.655487 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-52db788d-a2ba-4a13-97eb-67a33864baa5 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:04.656359 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-52db788d-a2ba-4a13-97eb-67a33864baa5 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:04.668523 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-52db788d-a2ba-4a13-97eb-67a33864baa5 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:04.669137 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-52db788d-a2ba-4a13-97eb-67a33864baa5 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:04.669668 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-52db788d-a2ba-4a13-97eb-67a33864baa5 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:04.670879 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-52db788d-a2ba-4a13-97eb-67a33864baa5 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:04.671690 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-52db788d-a2ba-4a13-97eb-67a33864baa5 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:04.672904 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-52db788d-a2ba-4a13-97eb-67a33864baa5 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:04.899280 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-52db788d-a2ba-4a13-97eb-67a33864baa5 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:04.920905 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-52db788d-a2ba-4a13-97eb-67a33864baa5 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1371 microversion: 2.1 time: 0.271110 Sep 01 14:09:04.921891 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 189/395] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:04 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1371 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:05.225713 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-d5415950-628e-40bd-ad42-ad51fd84d6ad tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:05.225713 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-d5415950-628e-40bd-ad42-ad51fd84d6ad tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:05.229014 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d5415950-628e-40bd-ad42-ad51fd84d6ad tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:05.229512 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d5415950-628e-40bd-ad42-ad51fd84d6ad tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:05.230069 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d5415950-628e-40bd-ad42-ad51fd84d6ad tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:05.230797 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d5415950-628e-40bd-ad42-ad51fd84d6ad tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:05.231245 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d5415950-628e-40bd-ad42-ad51fd84d6ad tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:05.232929 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d5415950-628e-40bd-ad42-ad51fd84d6ad tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:05.453684 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-63b6ceaf-771c-4eda-b9c6-89bdbb31864c tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:05.454298 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-63b6ceaf-771c-4eda-b9c6-89bdbb31864c tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 81fe7593-66bc-442e-bd42-67dbb727a356] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:05.463914 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-63b6ceaf-771c-4eda-b9c6-89bdbb31864c tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:05.464392 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-63b6ceaf-771c-4eda-b9c6-89bdbb31864c tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:05.464822 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-63b6ceaf-771c-4eda-b9c6-89bdbb31864c tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:05.465524 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-63b6ceaf-771c-4eda-b9c6-89bdbb31864c tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:05.466001 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-63b6ceaf-771c-4eda-b9c6-89bdbb31864c tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:05.466426 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-63b6ceaf-771c-4eda-b9c6-89bdbb31864c tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:05.665287 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-d5415950-628e-40bd-ad42-ad51fd84d6ad tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:05.688469 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-d5415950-628e-40bd-ad42-ad51fd84d6ad tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:05.691960 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-d5415950-628e-40bd-ad42-ad51fd84d6ad tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:05.694200 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-d5415950-628e-40bd-ad42-ad51fd84d6ad tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1810 microversion: 2.20 time: 0.480194 Sep 01 14:09:05.696274 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 207/396] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:09:05 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1810 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:09:05.727531 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-63b6ceaf-771c-4eda-b9c6-89bdbb31864c tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53d275b44a2432a9fe8611304bcfa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d998735c243c3bcd08ca2e2d81ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:05.741659 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-63b6ceaf-771c-4eda-b9c6-89bdbb31864c tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356" status: 200 len: 1319 microversion: 2.1 time: 0.291638 Sep 01 14:09:05.743639 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 190/397] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:05 2022] GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356 => generated 1319 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:05.951879 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [req-bc028161-f197-44a8-a8be-903562a197fc req-b95174bf-0b0f-413e-96ec-4615a00ae49d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81fe7593-66bc-442e-bd42-67dbb727a356", "name": "network-vif-plugged", "status": "completed", "tag": "cbd0d6ee-8ef6-4903-9342-88e28ddb8597"}]} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:09:05.956466 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-061cab6a-c583-4e29-bfb8-4d73a9ed76aa tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:05.958539 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-061cab6a-c583-4e29-bfb8-4d73a9ed76aa tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:05.968188 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-061cab6a-c583-4e29-bfb8-4d73a9ed76aa tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:05.977161 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-061cab6a-c583-4e29-bfb8-4d73a9ed76aa tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:05.977161 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-061cab6a-c583-4e29-bfb8-4d73a9ed76aa tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:05.977161 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-061cab6a-c583-4e29-bfb8-4d73a9ed76aa tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:05.977161 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-061cab6a-c583-4e29-bfb8-4d73a9ed76aa tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:05.977950 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-061cab6a-c583-4e29-bfb8-4d73a9ed76aa tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:05.985303 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-bc028161-f197-44a8-a8be-903562a197fc req-b95174bf-0b0f-413e-96ec-4615a00ae49d service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:05.992034 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-bc028161-f197-44a8-a8be-903562a197fc req-b95174bf-0b0f-413e-96ec-4615a00ae49d service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:05.995679 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-bc028161-f197-44a8-a8be-903562a197fc req-b95174bf-0b0f-413e-96ec-4615a00ae49d service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:06.049813 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.compute.server_external_events [req-bc028161-f197-44a8-a8be-903562a197fc req-b95174bf-0b0f-413e-96ec-4615a00ae49d service nova] Creating event network-vif-plugged:cbd0d6ee-8ef6-4903-9342-88e28ddb8597 for instance 81fe7593-66bc-442e-bd42-67dbb727a356 on hv-cinder-85221 Sep 01 14:09:06.072617 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [req-bc028161-f197-44a8-a8be-903562a197fc req-b95174bf-0b0f-413e-96ec-4615a00ae49d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128443 Sep 01 14:09:06.074428 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 208/398] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:09:06.225982 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-061cab6a-c583-4e29-bfb8-4d73a9ed76aa tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:06.235880 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-061cab6a-c583-4e29-bfb8-4d73a9ed76aa tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1371 microversion: 2.1 time: 0.293993 Sep 01 14:09:06.236672 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 191/399] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:05 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1371 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:06.735613 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-d22d3f5c-e42c-4c44-bf52-b097bc251766 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:06.737728 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-d22d3f5c-e42c-4c44-bf52-b097bc251766 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:06.748286 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d22d3f5c-e42c-4c44-bf52-b097bc251766 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:06.755264 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d22d3f5c-e42c-4c44-bf52-b097bc251766 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:06.755264 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d22d3f5c-e42c-4c44-bf52-b097bc251766 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:06.755264 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d22d3f5c-e42c-4c44-bf52-b097bc251766 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:06.755264 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d22d3f5c-e42c-4c44-bf52-b097bc251766 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:06.755759 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d22d3f5c-e42c-4c44-bf52-b097bc251766 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:06.770451 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-2a1fee07-0010-4e82-80a8-bea5587b2878 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:06.795375 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-2a1fee07-0010-4e82-80a8-bea5587b2878 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 81fe7593-66bc-442e-bd42-67dbb727a356] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:06.818414 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2a1fee07-0010-4e82-80a8-bea5587b2878 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:06.819281 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2a1fee07-0010-4e82-80a8-bea5587b2878 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:06.819930 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2a1fee07-0010-4e82-80a8-bea5587b2878 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:06.821001 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2a1fee07-0010-4e82-80a8-bea5587b2878 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:06.821793 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2a1fee07-0010-4e82-80a8-bea5587b2878 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:06.822423 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2a1fee07-0010-4e82-80a8-bea5587b2878 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:07.256926 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-2a1fee07-0010-4e82-80a8-bea5587b2878 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53d275b44a2432a9fe8611304bcfa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d998735c243c3bcd08ca2e2d81ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:07.273563 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-2a1fee07-0010-4e82-80a8-bea5587b2878 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356" status: 200 len: 1319 microversion: 2.1 time: 0.510074 Sep 01 14:09:07.275099 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 192/400] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:06 2022] GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356 => generated 1319 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:07.292076 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-5fc32c15-e49d-4363-921b-7504ecb5dd7b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c504c147-522f-4221-acc3-2090374b1b08"}} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:09:07.299885 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-5fc32c15-e49d-4363-921b-7504ecb5dd7b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 91814986-adf4-46cb-8edf-820106d37ecb] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:07.317088 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5fc32c15-e49d-4363-921b-7504ecb5dd7b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:07.317864 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5fc32c15-e49d-4363-921b-7504ecb5dd7b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:07.318825 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5fc32c15-e49d-4363-921b-7504ecb5dd7b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:07.320112 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5fc32c15-e49d-4363-921b-7504ecb5dd7b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:07.320959 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5fc32c15-e49d-4363-921b-7504ecb5dd7b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:07.322058 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5fc32c15-e49d-4363-921b-7504ecb5dd7b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:07.350667 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-d22d3f5c-e42c-4c44-bf52-b097bc251766 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:07.383251 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-d22d3f5c-e42c-4c44-bf52-b097bc251766 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:07.387175 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-d22d3f5c-e42c-4c44-bf52-b097bc251766 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:07.390191 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-d22d3f5c-e42c-4c44-bf52-b097bc251766 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1810 microversion: 2.20 time: 0.659124 Sep 01 14:09:07.391302 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 209/401] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:09:06 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1810 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:09:07.402751 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-8485b925-96ee-4608-a07f-6c27f140c558 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:07.410421 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-8485b925-96ee-4608-a07f-6c27f140c558 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:07.417934 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8485b925-96ee-4608-a07f-6c27f140c558 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:07.418810 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8485b925-96ee-4608-a07f-6c27f140c558 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:07.419415 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8485b925-96ee-4608-a07f-6c27f140c558 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:07.420364 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8485b925-96ee-4608-a07f-6c27f140c558 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:07.421017 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8485b925-96ee-4608-a07f-6c27f140c558 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:07.421631 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8485b925-96ee-4608-a07f-6c27f140c558 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:07.603409 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-8485b925-96ee-4608-a07f-6c27f140c558 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:07.612743 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-8485b925-96ee-4608-a07f-6c27f140c558 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1564 microversion: 2.1 time: 0.219676 Sep 01 14:09:07.613442 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 210/402] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:07 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1564 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:07.635155 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-87dfd45e-9eb4-4688-974a-9c60c82ab504 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:07.635652 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-87dfd45e-9eb4-4688-974a-9c60c82ab504 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:07.642013 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-87dfd45e-9eb4-4688-974a-9c60c82ab504 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:07.643114 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-87dfd45e-9eb4-4688-974a-9c60c82ab504 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:07.643795 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-87dfd45e-9eb4-4688-974a-9c60c82ab504 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:07.644654 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-87dfd45e-9eb4-4688-974a-9c60c82ab504 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:07.645357 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-87dfd45e-9eb4-4688-974a-9c60c82ab504 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:07.646000 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-87dfd45e-9eb4-4688-974a-9c60c82ab504 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:07.762109 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-87dfd45e-9eb4-4688-974a-9c60c82ab504 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.130738 Sep 01 14:09:07.766174 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 211/403] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Sep 1 14:09:07 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5/os-interface => generated 284 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:09:08.311805 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-a1ebe0cb-a971-46c7-ad23-c433c0eb71cd tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:08.313414 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-a1ebe0cb-a971-46c7-ad23-c433c0eb71cd tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 81fe7593-66bc-442e-bd42-67dbb727a356] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:08.325626 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a1ebe0cb-a971-46c7-ad23-c433c0eb71cd tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:08.326791 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a1ebe0cb-a971-46c7-ad23-c433c0eb71cd tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:08.328344 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a1ebe0cb-a971-46c7-ad23-c433c0eb71cd tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:08.329885 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a1ebe0cb-a971-46c7-ad23-c433c0eb71cd tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:08.338406 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a1ebe0cb-a971-46c7-ad23-c433c0eb71cd tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:08.339176 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a1ebe0cb-a971-46c7-ad23-c433c0eb71cd tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:08.541526 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-a1ebe0cb-a971-46c7-ad23-c433c0eb71cd tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53d275b44a2432a9fe8611304bcfa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d998735c243c3bcd08ca2e2d81ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:08.552045 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-a1ebe0cb-a971-46c7-ad23-c433c0eb71cd tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356" status: 200 len: 1319 microversion: 2.1 time: 0.246766 Sep 01 14:09:08.553402 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 212/404] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:08 2022] GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356 => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:09:08.558618 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-7b247656-0b1e-4eca-b4d1-fb9f70afaf19 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:08.559681 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-7b247656-0b1e-4eca-b4d1-fb9f70afaf19 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:08.572252 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7b247656-0b1e-4eca-b4d1-fb9f70afaf19 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:08.592467 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7b247656-0b1e-4eca-b4d1-fb9f70afaf19 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:08.593352 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7b247656-0b1e-4eca-b4d1-fb9f70afaf19 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:08.603596 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7b247656-0b1e-4eca-b4d1-fb9f70afaf19 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:08.604461 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7b247656-0b1e-4eca-b4d1-fb9f70afaf19 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:08.605324 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7b247656-0b1e-4eca-b4d1-fb9f70afaf19 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:08.855940 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-5fc32c15-e49d-4363-921b-7504ecb5dd7b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "POST /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.578377 Sep 01 14:09:08.858031 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 193/405] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Sep 1 14:09:07 2022] POST /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb/os-volume_attachments => generated 194 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:09:08.952767 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-7b247656-0b1e-4eca-b4d1-fb9f70afaf19 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:08.975937 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-7b247656-0b1e-4eca-b4d1-fb9f70afaf19 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:09.004827 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-7b247656-0b1e-4eca-b4d1-fb9f70afaf19 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:09.028103 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-7b247656-0b1e-4eca-b4d1-fb9f70afaf19 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1810 microversion: 2.20 time: 0.451863 Sep 01 14:09:09.035778 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 213/406] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:09:08 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1810 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:09:09.601818 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-c9a667c0-55d6-4625-8d05-1f945ad18773 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:09.605594 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-c9a667c0-55d6-4625-8d05-1f945ad18773 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 81fe7593-66bc-442e-bd42-67dbb727a356] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:09.610703 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c9a667c0-55d6-4625-8d05-1f945ad18773 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:09.611094 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c9a667c0-55d6-4625-8d05-1f945ad18773 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:09.613397 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c9a667c0-55d6-4625-8d05-1f945ad18773 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:09.614192 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c9a667c0-55d6-4625-8d05-1f945ad18773 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:09.614790 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c9a667c0-55d6-4625-8d05-1f945ad18773 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:09.615219 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c9a667c0-55d6-4625-8d05-1f945ad18773 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:10.055737 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-c9a667c0-55d6-4625-8d05-1f945ad18773 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53d275b44a2432a9fe8611304bcfa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d998735c243c3bcd08ca2e2d81ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:10.093670 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-7c25070d-4909-4e8f-940e-9aba80150e39 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:10.096760 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-7c25070d-4909-4e8f-940e-9aba80150e39 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:10.097799 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-c9a667c0-55d6-4625-8d05-1f945ad18773 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356" status: 200 len: 1509 microversion: 2.1 time: 0.500585 Sep 01 14:09:10.099351 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 194/407] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:09 2022] GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356 => generated 1509 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:10.115691 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7c25070d-4909-4e8f-940e-9aba80150e39 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:10.119005 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7c25070d-4909-4e8f-940e-9aba80150e39 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:10.124300 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7c25070d-4909-4e8f-940e-9aba80150e39 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:10.129259 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7c25070d-4909-4e8f-940e-9aba80150e39 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:10.130687 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7c25070d-4909-4e8f-940e-9aba80150e39 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:10.134173 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7c25070d-4909-4e8f-940e-9aba80150e39 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:10.431358 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-7c25070d-4909-4e8f-940e-9aba80150e39 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:10.447252 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-7c25070d-4909-4e8f-940e-9aba80150e39 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:10.452321 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-7c25070d-4909-4e8f-940e-9aba80150e39 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:10.460291 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-7c25070d-4909-4e8f-940e-9aba80150e39 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1810 microversion: 2.20 time: 0.375500 Sep 01 14:09:10.460291 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 214/408] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:09:10 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1810 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:09:11.143095 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [req-f1ff6388-9b5c-4332-9a62-43fb03763950 req-b9e115be-5050-4f2c-bfed-c1e02216f8af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1988647a-695e-49b8-a5d3-dd6c93c10ae5", "tag": "f27eab44-1c4b-4c5c-95ab-4dbdc5728861"}]} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:09:11.185752 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell0:SELECT=4 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:11.189527 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:11.203958 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-f1ff6388-9b5c-4332-9a62-43fb03763950 req-b9e115be-5050-4f2c-bfed-c1e02216f8af service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:11.205607 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-f1ff6388-9b5c-4332-9a62-43fb03763950 req-b9e115be-5050-4f2c-bfed-c1e02216f8af service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:11.206258 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-f1ff6388-9b5c-4332-9a62-43fb03763950 req-b9e115be-5050-4f2c-bfed-c1e02216f8af service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:11.238566 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.compute.server_external_events [req-f1ff6388-9b5c-4332-9a62-43fb03763950 req-b9e115be-5050-4f2c-bfed-c1e02216f8af service nova] Creating event network-changed:f27eab44-1c4b-4c5c-95ab-4dbdc5728861 for instance 1988647a-695e-49b8-a5d3-dd6c93c10ae5 on hv-cinder-85221 Sep 01 14:09:11.248047 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [req-f1ff6388-9b5c-4332-9a62-43fb03763950 req-b9e115be-5050-4f2c-bfed-c1e02216f8af service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111730 Sep 01 14:09:11.249215 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 195/409] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:09:11.480893 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-871553ee-bcfb-431d-b69c-2bbab312e370 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:11.481735 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-871553ee-bcfb-431d-b69c-2bbab312e370 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:11.507754 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-871553ee-bcfb-431d-b69c-2bbab312e370 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:11.509278 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-871553ee-bcfb-431d-b69c-2bbab312e370 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:11.510894 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-871553ee-bcfb-431d-b69c-2bbab312e370 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:11.514167 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-871553ee-bcfb-431d-b69c-2bbab312e370 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:11.516304 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-871553ee-bcfb-431d-b69c-2bbab312e370 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:11.517452 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-871553ee-bcfb-431d-b69c-2bbab312e370 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:12.844295 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-871553ee-bcfb-431d-b69c-2bbab312e370 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:12.879738 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-871553ee-bcfb-431d-b69c-2bbab312e370 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:12.884836 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-871553ee-bcfb-431d-b69c-2bbab312e370 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:12.889430 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-871553ee-bcfb-431d-b69c-2bbab312e370 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1810 microversion: 2.20 time: 1.412404 Sep 01 14:09:12.926005 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 215/410] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:09:11 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1810 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:09:13.947700 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-32a24663-2011-4bb6-9d3e-4181e3c6df65 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:13.963402 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-32a24663-2011-4bb6-9d3e-4181e3c6df65 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:13.984888 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-32a24663-2011-4bb6-9d3e-4181e3c6df65 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:13.989313 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-32a24663-2011-4bb6-9d3e-4181e3c6df65 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:13.990706 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-32a24663-2011-4bb6-9d3e-4181e3c6df65 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:14.000794 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-32a24663-2011-4bb6-9d3e-4181e3c6df65 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:14.002891 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-32a24663-2011-4bb6-9d3e-4181e3c6df65 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:14.003985 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-32a24663-2011-4bb6-9d3e-4181e3c6df65 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:14.054507 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=94,nova_cell1:INSERT=2 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:14.491121 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-32a24663-2011-4bb6-9d3e-4181e3c6df65 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:14.502780 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-32a24663-2011-4bb6-9d3e-4181e3c6df65 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:14.505495 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-32a24663-2011-4bb6-9d3e-4181e3c6df65 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:14.506776 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-32a24663-2011-4bb6-9d3e-4181e3c6df65 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1810 microversion: 2.20 time: 0.569137 Sep 01 14:09:14.507989 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 196/411] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:09:13 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1810 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:09:15.537860 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-acc56fd7-03aa-4861-842c-fb7e7010a140 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:15.538851 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-acc56fd7-03aa-4861-842c-fb7e7010a140 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:15.550167 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-acc56fd7-03aa-4861-842c-fb7e7010a140 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:15.553529 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-acc56fd7-03aa-4861-842c-fb7e7010a140 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:15.555530 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-acc56fd7-03aa-4861-842c-fb7e7010a140 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:15.566052 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-acc56fd7-03aa-4861-842c-fb7e7010a140 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:15.566052 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-acc56fd7-03aa-4861-842c-fb7e7010a140 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:15.566052 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-acc56fd7-03aa-4861-842c-fb7e7010a140 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:15.886900 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-acc56fd7-03aa-4861-842c-fb7e7010a140 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:15.911723 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-acc56fd7-03aa-4861-842c-fb7e7010a140 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:15.921760 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-acc56fd7-03aa-4861-842c-fb7e7010a140 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:15.921760 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-acc56fd7-03aa-4861-842c-fb7e7010a140 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1810 microversion: 2.20 time: 0.381469 Sep 01 14:09:15.921760 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 216/412] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:09:15 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1810 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:09:16.939512 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-fa27dc8d-0dd1-45c4-9c09-bcc960ee1cbe tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:16.940673 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-fa27dc8d-0dd1-45c4-9c09-bcc960ee1cbe tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:16.962066 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fa27dc8d-0dd1-45c4-9c09-bcc960ee1cbe tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:16.965670 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fa27dc8d-0dd1-45c4-9c09-bcc960ee1cbe tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:16.965670 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fa27dc8d-0dd1-45c4-9c09-bcc960ee1cbe tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:16.965670 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fa27dc8d-0dd1-45c4-9c09-bcc960ee1cbe tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:16.965670 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fa27dc8d-0dd1-45c4-9c09-bcc960ee1cbe tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:16.966423 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fa27dc8d-0dd1-45c4-9c09-bcc960ee1cbe tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:17.259295 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-fa27dc8d-0dd1-45c4-9c09-bcc960ee1cbe tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:17.284299 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-fa27dc8d-0dd1-45c4-9c09-bcc960ee1cbe tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:17.287502 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-fa27dc8d-0dd1-45c4-9c09-bcc960ee1cbe tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:17.294480 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-fa27dc8d-0dd1-45c4-9c09-bcc960ee1cbe tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1810 microversion: 2.20 time: 0.359478 Sep 01 14:09:17.295541 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 197/413] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:09:16 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1810 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:09:18.325632 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-cd46b003-406e-40fa-977d-ddaed5b39894 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:18.327017 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-cd46b003-406e-40fa-977d-ddaed5b39894 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:18.350458 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-cd46b003-406e-40fa-977d-ddaed5b39894 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:18.350458 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-cd46b003-406e-40fa-977d-ddaed5b39894 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:18.350458 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-cd46b003-406e-40fa-977d-ddaed5b39894 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:18.357350 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-cd46b003-406e-40fa-977d-ddaed5b39894 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:18.358224 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-cd46b003-406e-40fa-977d-ddaed5b39894 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:18.359522 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-cd46b003-406e-40fa-977d-ddaed5b39894 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:18.680550 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-cd46b003-406e-40fa-977d-ddaed5b39894 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:18.698948 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-cd46b003-406e-40fa-977d-ddaed5b39894 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:18.703158 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-cd46b003-406e-40fa-977d-ddaed5b39894 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:18.708148 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-cd46b003-406e-40fa-977d-ddaed5b39894 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1810 microversion: 2.20 time: 0.390363 Sep 01 14:09:18.713451 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 217/414] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:09:18 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1810 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:09:19.742244 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-646809fa-d14d-48c7-ae1b-f588da921fdc tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:19.742945 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-646809fa-d14d-48c7-ae1b-f588da921fdc tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:19.754313 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-646809fa-d14d-48c7-ae1b-f588da921fdc tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:19.754910 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-646809fa-d14d-48c7-ae1b-f588da921fdc tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:19.755360 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-646809fa-d14d-48c7-ae1b-f588da921fdc tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:19.756150 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-646809fa-d14d-48c7-ae1b-f588da921fdc tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:19.756570 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-646809fa-d14d-48c7-ae1b-f588da921fdc tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:19.756997 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-646809fa-d14d-48c7-ae1b-f588da921fdc tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:20.048399 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-646809fa-d14d-48c7-ae1b-f588da921fdc tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:20.062777 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-646809fa-d14d-48c7-ae1b-f588da921fdc tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:20.064331 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-646809fa-d14d-48c7-ae1b-f588da921fdc tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:20.066944 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-646809fa-d14d-48c7-ae1b-f588da921fdc tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1810 microversion: 2.20 time: 0.331370 Sep 01 14:09:20.067622 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 198/415] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:09:19 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1810 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:09:21.107208 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-c523c2f8-45c2-4bad-b36d-440e357c50c5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:21.108508 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-c523c2f8-45c2-4bad-b36d-440e357c50c5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:21.117445 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c523c2f8-45c2-4bad-b36d-440e357c50c5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:21.118418 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c523c2f8-45c2-4bad-b36d-440e357c50c5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:21.119141 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c523c2f8-45c2-4bad-b36d-440e357c50c5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:21.120127 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c523c2f8-45c2-4bad-b36d-440e357c50c5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:21.120808 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c523c2f8-45c2-4bad-b36d-440e357c50c5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:21.121452 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c523c2f8-45c2-4bad-b36d-440e357c50c5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:21.294313 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-c523c2f8-45c2-4bad-b36d-440e357c50c5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:21.316306 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-c523c2f8-45c2-4bad-b36d-440e357c50c5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:21.319948 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-c523c2f8-45c2-4bad-b36d-440e357c50c5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:21.322279 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-c523c2f8-45c2-4bad-b36d-440e357c50c5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1810 microversion: 2.20 time: 0.218678 Sep 01 14:09:21.324899 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 218/416] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:09:21 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1810 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:09:22.351576 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-dbc716ac-e9b0-496e-a11b-df0155e58f76 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:22.352408 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-dbc716ac-e9b0-496e-a11b-df0155e58f76 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:22.365114 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-dbc716ac-e9b0-496e-a11b-df0155e58f76 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:22.366088 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-dbc716ac-e9b0-496e-a11b-df0155e58f76 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:22.367331 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-dbc716ac-e9b0-496e-a11b-df0155e58f76 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:22.368597 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-dbc716ac-e9b0-496e-a11b-df0155e58f76 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:22.369324 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-dbc716ac-e9b0-496e-a11b-df0155e58f76 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:22.370324 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-dbc716ac-e9b0-496e-a11b-df0155e58f76 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:22.610991 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-dbc716ac-e9b0-496e-a11b-df0155e58f76 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:22.624353 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-dbc716ac-e9b0-496e-a11b-df0155e58f76 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:22.626409 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-dbc716ac-e9b0-496e-a11b-df0155e58f76 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:22.653494 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-dbc716ac-e9b0-496e-a11b-df0155e58f76 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1810 microversion: 2.20 time: 0.295921 Sep 01 14:09:22.653494 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 199/417] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:09:22 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1810 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:09:23.668583 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-d9efbc40-2477-4523-881a-fc717d1128b3 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:23.669202 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-d9efbc40-2477-4523-881a-fc717d1128b3 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:23.676580 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d9efbc40-2477-4523-881a-fc717d1128b3 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:23.677581 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d9efbc40-2477-4523-881a-fc717d1128b3 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:23.677581 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d9efbc40-2477-4523-881a-fc717d1128b3 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:23.678399 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d9efbc40-2477-4523-881a-fc717d1128b3 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:23.678848 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d9efbc40-2477-4523-881a-fc717d1128b3 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:23.679272 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d9efbc40-2477-4523-881a-fc717d1128b3 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:23.698979 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell1:SELECT=100 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:23.880645 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-96cd3053-430a-461d-8a87-19dc18c7e241 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Action: 'create', calling method: .version_select at 0x7f9867b60dc0>, body: {"keypair": {"name": "tempest-keypair-708943441", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItIaBMUr0dt67qSzjQMKa54LUF+ussLwyuzzWyOm14KVaXgpwmJgk24lYUQne8DYW6hv6a6uzfF/tx82U3r7AvELvgsA/b1Z9/O9ZV9olzTkDHqVoBJqUrHvN3h2MiHFg=="}} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:09:23.912098 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.quota [None req-96cd3053-430a-461d-8a87-19dc18c7e241 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Getting quotas for project 90a84500a899479aabfa3aeb72b4c4ae. Resources: {'key_pairs'} {{(pid=121339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:09:23.917084 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.quota [None req-96cd3053-430a-461d-8a87-19dc18c7e241 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Getting quotas for user 7ae66df61a764a42a1b1b15f54d5c34b and project 90a84500a899479aabfa3aeb72b4c4ae. Resources: {'key_pairs'} {{(pid=121339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:09:23.948356 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-d9efbc40-2477-4523-881a-fc717d1128b3 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:23.963373 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-d9efbc40-2477-4523-881a-fc717d1128b3 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:23.965626 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-d9efbc40-2477-4523-881a-fc717d1128b3 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:23.967894 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-d9efbc40-2477-4523-881a-fc717d1128b3 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1810 microversion: 2.20 time: 0.303438 Sep 01 14:09:23.968663 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 219/418] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:09:23 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1810 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:09:24.055667 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-96cd3053-430a-461d-8a87-19dc18c7e241 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.181195 Sep 01 14:09:24.056365 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 200/419] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Sep 1 14:09:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:09:24.993986 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-07317381-f9da-4890-bbf5-2867b0b6157c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:24.995154 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-07317381-f9da-4890-bbf5-2867b0b6157c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:25.006691 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-07317381-f9da-4890-bbf5-2867b0b6157c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:25.007443 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-07317381-f9da-4890-bbf5-2867b0b6157c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:25.008135 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-07317381-f9da-4890-bbf5-2867b0b6157c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:25.009613 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-07317381-f9da-4890-bbf5-2867b0b6157c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:25.010935 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-07317381-f9da-4890-bbf5-2867b0b6157c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:25.022377 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-07317381-f9da-4890-bbf5-2867b0b6157c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:25.548750 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-07317381-f9da-4890-bbf5-2867b0b6157c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:25.560492 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-07317381-f9da-4890-bbf5-2867b0b6157c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:25.562433 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-07317381-f9da-4890-bbf5-2867b0b6157c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:25.563687 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-07317381-f9da-4890-bbf5-2867b0b6157c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1810 microversion: 2.20 time: 0.573944 Sep 01 14:09:25.564268 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 220/420] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:09:24 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1810 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:09:26.604741 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-dae4b4e3-6014-4e76-9913-d5bf5a4fb731 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:26.606377 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-dae4b4e3-6014-4e76-9913-d5bf5a4fb731 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:26.639321 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-dae4b4e3-6014-4e76-9913-d5bf5a4fb731 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:26.640166 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-dae4b4e3-6014-4e76-9913-d5bf5a4fb731 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:26.640849 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-dae4b4e3-6014-4e76-9913-d5bf5a4fb731 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:26.642229 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-dae4b4e3-6014-4e76-9913-d5bf5a4fb731 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:26.645836 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-dae4b4e3-6014-4e76-9913-d5bf5a4fb731 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:26.646780 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-dae4b4e3-6014-4e76-9913-d5bf5a4fb731 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:26.919913 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-dae4b4e3-6014-4e76-9913-d5bf5a4fb731 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:26.933828 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-dae4b4e3-6014-4e76-9913-d5bf5a4fb731 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:26.935917 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-dae4b4e3-6014-4e76-9913-d5bf5a4fb731 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:26.937556 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-dae4b4e3-6014-4e76-9913-d5bf5a4fb731 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1810 microversion: 2.20 time: 0.347395 Sep 01 14:09:26.950474 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 201/421] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:09:26 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1810 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:09:27.223082 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-d9685997-95a1-40a7-af59-da1667375447 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1489349587", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1433320455", "security_groups": [{"name": "tempest-secgroup-smoke-57972656"}], "networks": [{"uuid": "d990df73-a69e-4562-a002-6a937695b5ba"}], "block_device_mapping_v2": [{"uuid": "4e6a9c36-0772-4ae2-87fa-16b59cc111e1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:09:27.436105 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.network.neutron [None req-d9685997-95a1-40a7-af59-da1667375447 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] validate_networks() for [('d990df73-a69e-4562-a002-6a937695b5ba', None, None, None, None, None)] {{(pid=121340) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:09:27.964940 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-2d0169e2-f707-4a03-bec1-2ba2a7c8dd0f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:27.965683 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-2d0169e2-f707-4a03-bec1-2ba2a7c8dd0f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:27.979450 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2d0169e2-f707-4a03-bec1-2ba2a7c8dd0f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:27.980188 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2d0169e2-f707-4a03-bec1-2ba2a7c8dd0f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:27.980748 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2d0169e2-f707-4a03-bec1-2ba2a7c8dd0f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:27.981503 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2d0169e2-f707-4a03-bec1-2ba2a7c8dd0f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:27.982358 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2d0169e2-f707-4a03-bec1-2ba2a7c8dd0f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:27.983434 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2d0169e2-f707-4a03-bec1-2ba2a7c8dd0f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:28.078994 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-d9685997-95a1-40a7-af59-da1667375447 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Flavor limits 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:09:28.081458 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-d9685997-95a1-40a7-af59-da1667375447 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Image limits 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:09:28.083290 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-d9685997-95a1-40a7-af59-da1667375447 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Flavor pref 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:09:28.084333 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-d9685997-95a1-40a7-af59-da1667375447 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Image pref 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:09:28.085265 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-d9685997-95a1-40a7-af59-da1667375447 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:09:28.103634 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d9685997-95a1-40a7-af59-da1667375447 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:28.104250 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d9685997-95a1-40a7-af59-da1667375447 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:28.104683 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d9685997-95a1-40a7-af59-da1667375447 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:28.105650 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d9685997-95a1-40a7-af59-da1667375447 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:28.106218 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d9685997-95a1-40a7-af59-da1667375447 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:28.107295 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d9685997-95a1-40a7-af59-da1667375447 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:28.131287 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.quota [None req-d9685997-95a1-40a7-af59-da1667375447 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Getting quotas for project c1c061b824cb4a92a469061e7a67f967. Resources: {'cores', 'instances', 'ram'} {{(pid=121340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:09:28.135989 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.quota [None req-d9685997-95a1-40a7-af59-da1667375447 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Getting quotas for user af1f81b83784472abc4b6ff4393afb7c and project c1c061b824cb4a92a469061e7a67f967. Resources: {'cores', 'instances', 'ram'} {{(pid=121340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:09:28.184055 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-2d0169e2-f707-4a03-bec1-2ba2a7c8dd0f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:28.194606 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-2d0169e2-f707-4a03-bec1-2ba2a7c8dd0f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:28.196428 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-2d0169e2-f707-4a03-bec1-2ba2a7c8dd0f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:28.197700 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-2d0169e2-f707-4a03-bec1-2ba2a7c8dd0f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1810 microversion: 2.20 time: 0.239011 Sep 01 14:09:28.198497 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 202/422] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:09:27 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1810 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:09:28.255919 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-d9685997-95a1-40a7-af59-da1667375447 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Going to run 1 instances... {{(pid=121340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:09:28.268571 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-d9685997-95a1-40a7-af59-da1667375447 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4e6a9c36-0772-4ae2-87fa-16b59cc111e1',volume_size=None,volume_type=None)] {{(pid=121340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:09:28.454015 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-eef19971-049e-4dc9-bd55-8b82f70660ce tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-223878466", "imageRef": "9be77128-e763-4225-b76f-85fbb04ad9b2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4f2459fa-f112-4ee1-abd3-6f4952507858"}], "security_groups": [{"name": "tempest-securitygroup--1275758600"}], "key_name": "tempest-keypair-708943441", "user_data": "}} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:09:28.600627 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.network.neutron [None req-eef19971-049e-4dc9-bd55-8b82f70660ce tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] validate_networks() for [('4f2459fa-f112-4ee1-abd3-6f4952507858', None, None, None, None, None)] {{(pid=121339) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:09:29.136132 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-d9685997-95a1-40a7-af59-da1667375447 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.919163 Sep 01 14:09:29.145085 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 221/423] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 1 14:09:27 2022] POST /compute/v2.1/servers => generated 404 bytes in 1929 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 14:09:29.153184 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-01a9ce4a-2976-426a-8c8e-f56c99495edf tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:29.154285 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-01a9ce4a-2976-426a-8c8e-f56c99495edf tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:29.331025 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-01a9ce4a-2976-426a-8c8e-f56c99495edf tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:29.339653 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-01a9ce4a-2976-426a-8c8e-f56c99495edf tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1089 microversion: 2.1 time: 0.192986 Sep 01 14:09:29.341502 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 222/424] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:29 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1089 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:29.349023 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-6d35e1c1-28b1-4e22-aa68-70bf760f60a7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:29.349938 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-6d35e1c1-28b1-4e22-aa68-70bf760f60a7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:29.357813 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6d35e1c1-28b1-4e22-aa68-70bf760f60a7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:29.359380 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6d35e1c1-28b1-4e22-aa68-70bf760f60a7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:29.362209 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6d35e1c1-28b1-4e22-aa68-70bf760f60a7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:29.362209 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6d35e1c1-28b1-4e22-aa68-70bf760f60a7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:29.362209 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6d35e1c1-28b1-4e22-aa68-70bf760f60a7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:29.363148 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6d35e1c1-28b1-4e22-aa68-70bf760f60a7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:29.723074 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.virt.hardware [None req-eef19971-049e-4dc9-bd55-8b82f70660ce tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Flavor limits 0:0:0 {{(pid=121339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:09:29.723660 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.virt.hardware [None req-eef19971-049e-4dc9-bd55-8b82f70660ce tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Image limits 0:0:0 {{(pid=121339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:09:29.725050 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.virt.hardware [None req-eef19971-049e-4dc9-bd55-8b82f70660ce tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Flavor pref 0:0:0 {{(pid=121339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:09:29.725050 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.virt.hardware [None req-eef19971-049e-4dc9-bd55-8b82f70660ce tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Image pref 0:0:0 {{(pid=121339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:09:29.725050 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.virt.hardware [None req-eef19971-049e-4dc9-bd55-8b82f70660ce tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:09:29.740984 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-eef19971-049e-4dc9-bd55-8b82f70660ce tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:29.741758 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-eef19971-049e-4dc9-bd55-8b82f70660ce tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:29.742224 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-eef19971-049e-4dc9-bd55-8b82f70660ce tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:29.742961 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-eef19971-049e-4dc9-bd55-8b82f70660ce tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:29.743414 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-eef19971-049e-4dc9-bd55-8b82f70660ce tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:29.744009 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-eef19971-049e-4dc9-bd55-8b82f70660ce tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:29.764332 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.quota [None req-eef19971-049e-4dc9-bd55-8b82f70660ce tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Getting quotas for project 90a84500a899479aabfa3aeb72b4c4ae. Resources: {'cores', 'instances', 'ram'} {{(pid=121339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:09:29.765742 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-6d35e1c1-28b1-4e22-aa68-70bf760f60a7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:29.769509 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.quota [None req-eef19971-049e-4dc9-bd55-8b82f70660ce tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Getting quotas for user 7ae66df61a764a42a1b1b15f54d5c34b and project 90a84500a899479aabfa3aeb72b4c4ae. Resources: {'cores', 'instances', 'ram'} {{(pid=121339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:09:29.780972 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-6d35e1c1-28b1-4e22-aa68-70bf760f60a7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:29.784433 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-6d35e1c1-28b1-4e22-aa68-70bf760f60a7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:29.786586 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-6d35e1c1-28b1-4e22-aa68-70bf760f60a7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1810 microversion: 2.20 time: 0.443465 Sep 01 14:09:29.787527 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-eef19971-049e-4dc9-bd55-8b82f70660ce tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Going to run 1 instances... {{(pid=121339) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:09:29.788867 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 223/425] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:09:29 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1810 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:09:29.790325 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-eef19971-049e-4dc9-bd55-8b82f70660ce tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 3e82006c-11f2-43d8-b929-e161f9c506d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9be77128-e763-4225-b76f-85fbb04ad9b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:09:29.983079 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-eef19971-049e-4dc9-bd55-8b82f70660ce tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.533399 Sep 01 14:09:29.994028 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 203/426] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 1 14:09:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 1545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 14:09:29.998222 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-23110017-1d73-4aa7-b8a5-3e706dae9462 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:29.999495 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-23110017-1d73-4aa7-b8a5-3e706dae9462 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 3e82006c-11f2-43d8-b929-e161f9c506d4] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:30.073669 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-23110017-1d73-4aa7-b8a5-3e706dae9462 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:30.091924 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-23110017-1d73-4aa7-b8a5-3e706dae9462 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4" status: 200 len: 1240 microversion: 2.1 time: 0.098758 Sep 01 14:09:30.106696 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 224/427] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:29 2022] GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4 => generated 1240 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:30.367726 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-a336eeda-f7da-4a15-a0a3-41f85d42cb90 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:30.369286 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-a336eeda-f7da-4a15-a0a3-41f85d42cb90 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:30.485468 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-a336eeda-f7da-4a15-a0a3-41f85d42cb90 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:30.502446 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-a336eeda-f7da-4a15-a0a3-41f85d42cb90 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1089 microversion: 2.1 time: 0.141482 Sep 01 14:09:30.504890 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 204/428] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:30 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1089 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:30.841078 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-23cf5446-37ca-48fa-874b-d74d5ee7f161 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:30.841967 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-23cf5446-37ca-48fa-874b-d74d5ee7f161 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:30.865933 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-23cf5446-37ca-48fa-874b-d74d5ee7f161 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:30.866455 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-23cf5446-37ca-48fa-874b-d74d5ee7f161 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:30.866888 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-23cf5446-37ca-48fa-874b-d74d5ee7f161 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:30.867643 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-23cf5446-37ca-48fa-874b-d74d5ee7f161 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:30.868181 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-23cf5446-37ca-48fa-874b-d74d5ee7f161 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:30.868920 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-23cf5446-37ca-48fa-874b-d74d5ee7f161 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:31.122161 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-ef4cfdc5-a55a-4598-9cec-0ef6a2fcc65e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:31.122161 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-ef4cfdc5-a55a-4598-9cec-0ef6a2fcc65e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 3e82006c-11f2-43d8-b929-e161f9c506d4] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:31.231293 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-23cf5446-37ca-48fa-874b-d74d5ee7f161 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:31.262638 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-23cf5446-37ca-48fa-874b-d74d5ee7f161 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:31.271468 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-23cf5446-37ca-48fa-874b-d74d5ee7f161 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:31.285165 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-23cf5446-37ca-48fa-874b-d74d5ee7f161 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1810 microversion: 2.20 time: 0.448323 Sep 01 14:09:31.286680 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 225/429] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:09:30 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1810 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:09:31.311045 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-ef4cfdc5-a55a-4598-9cec-0ef6a2fcc65e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:31.325395 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-ef4cfdc5-a55a-4598-9cec-0ef6a2fcc65e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4" status: 200 len: 1240 microversion: 2.1 time: 0.213115 Sep 01 14:09:31.326034 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 205/430] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:31 2022] GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4 => generated 1240 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:31.545187 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-e096f267-9fc4-4b22-993a-430b311087df tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:31.546110 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-e096f267-9fc4-4b22-993a-430b311087df tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:31.559826 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e096f267-9fc4-4b22-993a-430b311087df tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:31.559826 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e096f267-9fc4-4b22-993a-430b311087df tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:31.559826 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e096f267-9fc4-4b22-993a-430b311087df tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:31.559826 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e096f267-9fc4-4b22-993a-430b311087df tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:31.560410 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e096f267-9fc4-4b22-993a-430b311087df tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:31.560410 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e096f267-9fc4-4b22-993a-430b311087df tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:31.638239 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-e096f267-9fc4-4b22-993a-430b311087df tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:31.650547 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-e096f267-9fc4-4b22-993a-430b311087df tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1139 microversion: 2.1 time: 0.109203 Sep 01 14:09:31.651553 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 226/431] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:31 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1139 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:09:32.090570 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [req-380900bb-53f2-426a-a462-9ec90d5b4bd8 req-e948876b-1059-4870-b746-ba2a2711c4a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d39f7090-b419-46be-9fcc-7ae73004ab71", "name": "network-vif-plugged", "status": "completed", "tag": "9ae4ab09-714c-4175-ba0d-7b76b31e652d"}]} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:09:32.117945 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-380900bb-53f2-426a-a462-9ec90d5b4bd8 req-e948876b-1059-4870-b746-ba2a2711c4a3 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:32.118470 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-380900bb-53f2-426a-a462-9ec90d5b4bd8 req-e948876b-1059-4870-b746-ba2a2711c4a3 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:32.118874 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-380900bb-53f2-426a-a462-9ec90d5b4bd8 req-e948876b-1059-4870-b746-ba2a2711c4a3 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:32.155376 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.compute.server_external_events [req-380900bb-53f2-426a-a462-9ec90d5b4bd8 req-e948876b-1059-4870-b746-ba2a2711c4a3 service nova] Creating event network-vif-plugged:9ae4ab09-714c-4175-ba0d-7b76b31e652d for instance d39f7090-b419-46be-9fcc-7ae73004ab71 on hv-cinder-85221 Sep 01 14:09:32.168920 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [req-380900bb-53f2-426a-a462-9ec90d5b4bd8 req-e948876b-1059-4870-b746-ba2a2711c4a3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081436 Sep 01 14:09:32.170016 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 206/432] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:09:32.319134 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-50946983-ae14-4b1b-85c7-8c16058c426b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:32.320595 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-50946983-ae14-4b1b-85c7-8c16058c426b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:32.344220 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-50946983-ae14-4b1b-85c7-8c16058c426b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:32.345264 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-50946983-ae14-4b1b-85c7-8c16058c426b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:32.346121 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-50946983-ae14-4b1b-85c7-8c16058c426b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:32.347426 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-50946983-ae14-4b1b-85c7-8c16058c426b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:32.348480 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-50946983-ae14-4b1b-85c7-8c16058c426b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:32.349254 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-50946983-ae14-4b1b-85c7-8c16058c426b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:32.367968 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-06a07dc1-1e04-43c6-884f-2a245fff729a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:32.373089 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-06a07dc1-1e04-43c6-884f-2a245fff729a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 3e82006c-11f2-43d8-b929-e161f9c506d4] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:32.405413 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-06a07dc1-1e04-43c6-884f-2a245fff729a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:32.410206 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-06a07dc1-1e04-43c6-884f-2a245fff729a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:32.415446 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-06a07dc1-1e04-43c6-884f-2a245fff729a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:32.420615 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-06a07dc1-1e04-43c6-884f-2a245fff729a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:32.427026 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-06a07dc1-1e04-43c6-884f-2a245fff729a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:32.428391 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-06a07dc1-1e04-43c6-884f-2a245fff729a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:32.621456 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-06a07dc1-1e04-43c6-884f-2a245fff729a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:32.672878 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-06a07dc1-1e04-43c6-884f-2a245fff729a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4" status: 200 len: 1244 microversion: 2.1 time: 0.305311 Sep 01 14:09:32.677171 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 207/433] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:32 2022] GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4 => generated 1244 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:32.712257 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-d4d8a443-3c29-4064-a24a-c5168336837e tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:32.715371 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-d4d8a443-3c29-4064-a24a-c5168336837e tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:32.732175 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d4d8a443-3c29-4064-a24a-c5168336837e tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:32.732691 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d4d8a443-3c29-4064-a24a-c5168336837e tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:32.736717 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d4d8a443-3c29-4064-a24a-c5168336837e tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:32.738425 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d4d8a443-3c29-4064-a24a-c5168336837e tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:32.739211 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d4d8a443-3c29-4064-a24a-c5168336837e tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:32.739778 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d4d8a443-3c29-4064-a24a-c5168336837e tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:32.747157 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-50946983-ae14-4b1b-85c7-8c16058c426b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:32.763380 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-50946983-ae14-4b1b-85c7-8c16058c426b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:32.765550 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-50946983-ae14-4b1b-85c7-8c16058c426b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:32.767246 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-50946983-ae14-4b1b-85c7-8c16058c426b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1810 microversion: 2.20 time: 0.459781 Sep 01 14:09:32.783732 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 227/434] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:09:32 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1810 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:09:32.918024 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-d4d8a443-3c29-4064-a24a-c5168336837e tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:32.938288 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-d4d8a443-3c29-4064-a24a-c5168336837e tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1131 microversion: 2.1 time: 0.255607 Sep 01 14:09:32.942421 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 208/435] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:32 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1131 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:33.700860 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-4ccbaea2-d4cc-4c68-b5bd-ec16cfd2f5d6 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:33.702271 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-4ccbaea2-d4cc-4c68-b5bd-ec16cfd2f5d6 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 3e82006c-11f2-43d8-b929-e161f9c506d4] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:33.717633 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4ccbaea2-d4cc-4c68-b5bd-ec16cfd2f5d6 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:33.718651 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4ccbaea2-d4cc-4c68-b5bd-ec16cfd2f5d6 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:33.720181 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4ccbaea2-d4cc-4c68-b5bd-ec16cfd2f5d6 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:33.721990 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4ccbaea2-d4cc-4c68-b5bd-ec16cfd2f5d6 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:33.722675 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4ccbaea2-d4cc-4c68-b5bd-ec16cfd2f5d6 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:33.723527 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4ccbaea2-d4cc-4c68-b5bd-ec16cfd2f5d6 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:33.793181 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-b42dbb79-feba-4fb2-8af2-22e0e11e1f00 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:33.794366 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-b42dbb79-feba-4fb2-8af2-22e0e11e1f00 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:33.810946 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b42dbb79-feba-4fb2-8af2-22e0e11e1f00 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:33.811428 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-4ccbaea2-d4cc-4c68-b5bd-ec16cfd2f5d6 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:33.811580 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b42dbb79-feba-4fb2-8af2-22e0e11e1f00 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:33.811959 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b42dbb79-feba-4fb2-8af2-22e0e11e1f00 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:33.812697 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b42dbb79-feba-4fb2-8af2-22e0e11e1f00 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:33.813157 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b42dbb79-feba-4fb2-8af2-22e0e11e1f00 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:33.813580 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b42dbb79-feba-4fb2-8af2-22e0e11e1f00 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:33.826331 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-4ccbaea2-d4cc-4c68-b5bd-ec16cfd2f5d6 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4" status: 200 len: 1292 microversion: 2.1 time: 0.130569 Sep 01 14:09:33.827393 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 228/436] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:33 2022] GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4 => generated 1292 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:09:33.975625 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-c021eabd-6e85-4ac8-9511-323b2233ffea tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:33.976885 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-c021eabd-6e85-4ac8-9511-323b2233ffea tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:33.985259 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c021eabd-6e85-4ac8-9511-323b2233ffea tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:33.986735 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c021eabd-6e85-4ac8-9511-323b2233ffea tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:33.987645 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c021eabd-6e85-4ac8-9511-323b2233ffea tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:33.988448 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c021eabd-6e85-4ac8-9511-323b2233ffea tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:33.989058 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c021eabd-6e85-4ac8-9511-323b2233ffea tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:33.989815 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c021eabd-6e85-4ac8-9511-323b2233ffea tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:34.024727 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-b42dbb79-feba-4fb2-8af2-22e0e11e1f00 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:34.043815 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-b42dbb79-feba-4fb2-8af2-22e0e11e1f00 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:34.049693 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-b42dbb79-feba-4fb2-8af2-22e0e11e1f00 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:34.056774 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-b42dbb79-feba-4fb2-8af2-22e0e11e1f00 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1810 microversion: 2.20 time: 0.268762 Sep 01 14:09:34.057237 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 209/437] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:09:33 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1810 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:09:34.145977 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-c021eabd-6e85-4ac8-9511-323b2233ffea tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:34.168923 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-c021eabd-6e85-4ac8-9511-323b2233ffea tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1187 microversion: 2.1 time: 0.201761 Sep 01 14:09:34.170452 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 229/438] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:33 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1187 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:09:34.857202 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-8840daca-b5ba-4f02-80e6-7d9d52a5fb8b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:34.859278 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-8840daca-b5ba-4f02-80e6-7d9d52a5fb8b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 3e82006c-11f2-43d8-b929-e161f9c506d4] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:34.867484 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8840daca-b5ba-4f02-80e6-7d9d52a5fb8b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:34.868268 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8840daca-b5ba-4f02-80e6-7d9d52a5fb8b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:34.868710 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8840daca-b5ba-4f02-80e6-7d9d52a5fb8b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:34.869439 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8840daca-b5ba-4f02-80e6-7d9d52a5fb8b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:34.869942 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8840daca-b5ba-4f02-80e6-7d9d52a5fb8b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:34.870454 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8840daca-b5ba-4f02-80e6-7d9d52a5fb8b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:34.984621 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-8840daca-b5ba-4f02-80e6-7d9d52a5fb8b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:35.018913 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-8840daca-b5ba-4f02-80e6-7d9d52a5fb8b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4" status: 200 len: 1292 microversion: 2.1 time: 0.165887 Sep 01 14:09:35.035758 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 210/439] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:34 2022] GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4 => generated 1292 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:35.107662 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-926de221-e676-4191-bc8f-85ce4ed2fd18 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:35.112115 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-926de221-e676-4191-bc8f-85ce4ed2fd18 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:35.137600 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:35.143965 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-926de221-e676-4191-bc8f-85ce4ed2fd18 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:35.143965 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-926de221-e676-4191-bc8f-85ce4ed2fd18 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:35.143965 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-926de221-e676-4191-bc8f-85ce4ed2fd18 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:35.145205 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-926de221-e676-4191-bc8f-85ce4ed2fd18 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:35.145946 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-926de221-e676-4191-bc8f-85ce4ed2fd18 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:35.147569 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-926de221-e676-4191-bc8f-85ce4ed2fd18 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:35.199051 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-22450888-dde9-4d84-bd45-527927f0a08b tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:35.200127 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-22450888-dde9-4d84-bd45-527927f0a08b tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:35.237520 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-22450888-dde9-4d84-bd45-527927f0a08b tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:35.238485 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-22450888-dde9-4d84-bd45-527927f0a08b tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:35.239241 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-22450888-dde9-4d84-bd45-527927f0a08b tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:35.241022 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-22450888-dde9-4d84-bd45-527927f0a08b tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:35.241847 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-22450888-dde9-4d84-bd45-527927f0a08b tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:35.242821 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-22450888-dde9-4d84-bd45-527927f0a08b tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:35.416316 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-22450888-dde9-4d84-bd45-527927f0a08b tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:35.465030 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-22450888-dde9-4d84-bd45-527927f0a08b tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1187 microversion: 2.1 time: 0.273575 Sep 01 14:09:35.472389 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 211/440] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:35 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1187 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:35.522764 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-926de221-e676-4191-bc8f-85ce4ed2fd18 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:35.540772 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-926de221-e676-4191-bc8f-85ce4ed2fd18 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:35.542396 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-926de221-e676-4191-bc8f-85ce4ed2fd18 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:35.543644 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-926de221-e676-4191-bc8f-85ce4ed2fd18 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1810 microversion: 2.20 time: 0.444617 Sep 01 14:09:35.544216 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 230/441] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:09:35 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1810 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:09:36.069259 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-54af8ec2-dea0-41a7-acaa-281f9673aa24 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:36.069259 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-54af8ec2-dea0-41a7-acaa-281f9673aa24 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 3e82006c-11f2-43d8-b929-e161f9c506d4] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:36.090075 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-54af8ec2-dea0-41a7-acaa-281f9673aa24 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:36.090726 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-54af8ec2-dea0-41a7-acaa-281f9673aa24 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:36.091275 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-54af8ec2-dea0-41a7-acaa-281f9673aa24 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:36.092101 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-54af8ec2-dea0-41a7-acaa-281f9673aa24 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:36.092905 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-54af8ec2-dea0-41a7-acaa-281f9673aa24 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:36.093404 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-54af8ec2-dea0-41a7-acaa-281f9673aa24 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:36.257458 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-54af8ec2-dea0-41a7-acaa-281f9673aa24 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:36.266740 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-54af8ec2-dea0-41a7-acaa-281f9673aa24 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4" status: 200 len: 1292 microversion: 2.1 time: 0.211017 Sep 01 14:09:36.267624 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 212/442] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:36 2022] GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4 => generated 1292 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:36.506808 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-f82969ce-3627-4bcc-afae-932aa6f007d2 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:36.508104 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-f82969ce-3627-4bcc-afae-932aa6f007d2 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:36.515335 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f82969ce-3627-4bcc-afae-932aa6f007d2 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:36.515819 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f82969ce-3627-4bcc-afae-932aa6f007d2 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:36.516449 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f82969ce-3627-4bcc-afae-932aa6f007d2 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:36.517169 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f82969ce-3627-4bcc-afae-932aa6f007d2 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:36.517676 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f82969ce-3627-4bcc-afae-932aa6f007d2 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:36.518343 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f82969ce-3627-4bcc-afae-932aa6f007d2 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:36.570651 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-55ae760a-cb82-4f70-9475-1d62ae2e402a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:36.582999 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-55ae760a-cb82-4f70-9475-1d62ae2e402a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:36.619150 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-55ae760a-cb82-4f70-9475-1d62ae2e402a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:36.621712 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-55ae760a-cb82-4f70-9475-1d62ae2e402a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:36.623218 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-55ae760a-cb82-4f70-9475-1d62ae2e402a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:36.624549 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-55ae760a-cb82-4f70-9475-1d62ae2e402a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:36.626366 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-55ae760a-cb82-4f70-9475-1d62ae2e402a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:36.633355 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-55ae760a-cb82-4f70-9475-1d62ae2e402a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:36.641559 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-f82969ce-3627-4bcc-afae-932aa6f007d2 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:36.665342 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-f82969ce-3627-4bcc-afae-932aa6f007d2 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1205 microversion: 2.1 time: 0.162459 Sep 01 14:09:36.670487 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 231/443] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:36 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1205 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:09:36.851503 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-55ae760a-cb82-4f70-9475-1d62ae2e402a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:36.863367 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-55ae760a-cb82-4f70-9475-1d62ae2e402a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:36.865141 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-55ae760a-cb82-4f70-9475-1d62ae2e402a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:36.866572 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-55ae760a-cb82-4f70-9475-1d62ae2e402a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1810 microversion: 2.20 time: 0.301051 Sep 01 14:09:36.879858 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 213/444] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:09:36 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1810 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:09:37.297953 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-0024a1d4-9d3e-4fa5-948b-778fdf70c32a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:37.301841 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-0024a1d4-9d3e-4fa5-948b-778fdf70c32a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 3e82006c-11f2-43d8-b929-e161f9c506d4] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:37.318190 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0024a1d4-9d3e-4fa5-948b-778fdf70c32a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:37.320019 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0024a1d4-9d3e-4fa5-948b-778fdf70c32a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:37.321102 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0024a1d4-9d3e-4fa5-948b-778fdf70c32a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:37.324792 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0024a1d4-9d3e-4fa5-948b-778fdf70c32a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:37.326487 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0024a1d4-9d3e-4fa5-948b-778fdf70c32a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:37.327751 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0024a1d4-9d3e-4fa5-948b-778fdf70c32a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:37.528111 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-0024a1d4-9d3e-4fa5-948b-778fdf70c32a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:37.562777 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-0024a1d4-9d3e-4fa5-948b-778fdf70c32a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4" status: 200 len: 1298 microversion: 2.1 time: 0.276088 Sep 01 14:09:37.563846 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 232/445] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:37 2022] GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4 => generated 1298 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:37.699376 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-ad227754-9df8-4632-b3bd-272c634fb681 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:37.700502 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-ad227754-9df8-4632-b3bd-272c634fb681 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:37.722835 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ad227754-9df8-4632-b3bd-272c634fb681 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:37.723676 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ad227754-9df8-4632-b3bd-272c634fb681 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:37.725363 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ad227754-9df8-4632-b3bd-272c634fb681 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:37.729348 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ad227754-9df8-4632-b3bd-272c634fb681 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:37.730176 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ad227754-9df8-4632-b3bd-272c634fb681 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:37.731100 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ad227754-9df8-4632-b3bd-272c634fb681 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:37.897256 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-9f34810e-9b03-4ba6-8da4-3734ca8c7380 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:37.909495 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-9f34810e-9b03-4ba6-8da4-3734ca8c7380 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:37.934345 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9f34810e-9b03-4ba6-8da4-3734ca8c7380 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:37.935622 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9f34810e-9b03-4ba6-8da4-3734ca8c7380 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:37.937097 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9f34810e-9b03-4ba6-8da4-3734ca8c7380 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:37.938775 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9f34810e-9b03-4ba6-8da4-3734ca8c7380 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:37.943254 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9f34810e-9b03-4ba6-8da4-3734ca8c7380 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:37.944114 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9f34810e-9b03-4ba6-8da4-3734ca8c7380 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:38.124707 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell0:SELECT=2 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:38.358405 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-ad227754-9df8-4632-b3bd-272c634fb681 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:38.385259 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-ad227754-9df8-4632-b3bd-272c634fb681 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1271 microversion: 2.1 time: 0.692798 Sep 01 14:09:38.404123 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 214/446] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:37 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1271 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:38.482313 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-9f34810e-9b03-4ba6-8da4-3734ca8c7380 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:38.501426 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-9f34810e-9b03-4ba6-8da4-3734ca8c7380 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:38.505013 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-9f34810e-9b03-4ba6-8da4-3734ca8c7380 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:38.507194 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-9f34810e-9b03-4ba6-8da4-3734ca8c7380 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1810 microversion: 2.20 time: 0.618645 Sep 01 14:09:38.515001 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 233/447] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:09:37 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1810 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:09:38.591770 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-69fecdff-8800-42b7-994c-e60ea4070753 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:38.592937 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-69fecdff-8800-42b7-994c-e60ea4070753 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 3e82006c-11f2-43d8-b929-e161f9c506d4] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:38.621544 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-69fecdff-8800-42b7-994c-e60ea4070753 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:38.626459 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-69fecdff-8800-42b7-994c-e60ea4070753 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:38.628952 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-69fecdff-8800-42b7-994c-e60ea4070753 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:38.631792 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-69fecdff-8800-42b7-994c-e60ea4070753 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:38.633077 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-69fecdff-8800-42b7-994c-e60ea4070753 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:38.634566 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-69fecdff-8800-42b7-994c-e60ea4070753 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:38.855316 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-69fecdff-8800-42b7-994c-e60ea4070753 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:38.895912 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-69fecdff-8800-42b7-994c-e60ea4070753 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4" status: 200 len: 1298 microversion: 2.1 time: 0.292023 Sep 01 14:09:38.898794 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 215/448] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:38 2022] GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4 => generated 1298 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:39.422124 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-9a6d06a6-16f1-4cf8-ab34-d2983178478c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:39.422961 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-9a6d06a6-16f1-4cf8-ab34-d2983178478c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:39.442623 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9a6d06a6-16f1-4cf8-ab34-d2983178478c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:39.444406 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9a6d06a6-16f1-4cf8-ab34-d2983178478c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:39.451372 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9a6d06a6-16f1-4cf8-ab34-d2983178478c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:39.454480 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9a6d06a6-16f1-4cf8-ab34-d2983178478c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:39.455199 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9a6d06a6-16f1-4cf8-ab34-d2983178478c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:39.455655 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9a6d06a6-16f1-4cf8-ab34-d2983178478c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:39.539714 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-8a80b696-97e3-4fb8-a729-3dbb2b5e9cb8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:39.543334 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-8a80b696-97e3-4fb8-a729-3dbb2b5e9cb8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:39.577649 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8a80b696-97e3-4fb8-a729-3dbb2b5e9cb8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:39.578888 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8a80b696-97e3-4fb8-a729-3dbb2b5e9cb8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:39.616627 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8a80b696-97e3-4fb8-a729-3dbb2b5e9cb8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:39.620266 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8a80b696-97e3-4fb8-a729-3dbb2b5e9cb8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:39.623570 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8a80b696-97e3-4fb8-a729-3dbb2b5e9cb8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:39.625335 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8a80b696-97e3-4fb8-a729-3dbb2b5e9cb8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:39.757808 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell0:SELECT=2 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:39.831922 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-9a6d06a6-16f1-4cf8-ab34-d2983178478c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:39.864730 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-9a6d06a6-16f1-4cf8-ab34-d2983178478c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1259 microversion: 2.1 time: 0.447729 Sep 01 14:09:39.866331 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 234/449] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:39 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1259 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:39.920998 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-d4c5a613-e936-4e80-9261-b9634ed62d7c tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:39.921742 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-d4c5a613-e936-4e80-9261-b9634ed62d7c tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 3e82006c-11f2-43d8-b929-e161f9c506d4] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:39.936766 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d4c5a613-e936-4e80-9261-b9634ed62d7c tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:39.940930 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d4c5a613-e936-4e80-9261-b9634ed62d7c tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:39.943688 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d4c5a613-e936-4e80-9261-b9634ed62d7c tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:39.944749 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d4c5a613-e936-4e80-9261-b9634ed62d7c tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:39.947512 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d4c5a613-e936-4e80-9261-b9634ed62d7c tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:39.948347 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d4c5a613-e936-4e80-9261-b9634ed62d7c tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:40.079930 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell0:SELECT=10 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:40.143288 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-8a80b696-97e3-4fb8-a729-3dbb2b5e9cb8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:40.154102 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-8a80b696-97e3-4fb8-a729-3dbb2b5e9cb8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:40.158451 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-8a80b696-97e3-4fb8-a729-3dbb2b5e9cb8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:40.165056 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-8a80b696-97e3-4fb8-a729-3dbb2b5e9cb8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1797 microversion: 2.20 time: 0.635433 Sep 01 14:09:40.170312 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 216/450] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:09:39 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1797 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:09:40.226931 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-d4c5a613-e936-4e80-9261-b9634ed62d7c tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:40.242633 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-d4c5a613-e936-4e80-9261-b9634ed62d7c tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4" status: 200 len: 1366 microversion: 2.1 time: 0.322273 Sep 01 14:09:40.242633 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 235/451] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:39 2022] GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4 => generated 1366 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:09:40.369009 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [req-30956efe-d164-4ef0-87d1-c869522268af req-3d75c44d-14ad-49d3-9041-a4dae7460e49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cc866f4-91c1-4384-b88a-5866ca150aea", "tag": "9b44c940-faa5-4df3-83f2-2d676ad70287"}]} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:09:40.401009 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-30956efe-d164-4ef0-87d1-c869522268af req-3d75c44d-14ad-49d3-9041-a4dae7460e49 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:40.404105 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-30956efe-d164-4ef0-87d1-c869522268af req-3d75c44d-14ad-49d3-9041-a4dae7460e49 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:40.404105 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-30956efe-d164-4ef0-87d1-c869522268af req-3d75c44d-14ad-49d3-9041-a4dae7460e49 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:40.423433 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell1:SELECT=100 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:40.435785 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.compute.server_external_events [req-30956efe-d164-4ef0-87d1-c869522268af req-3d75c44d-14ad-49d3-9041-a4dae7460e49 service nova] Creating event network-changed:9b44c940-faa5-4df3-83f2-2d676ad70287 for instance 3cc866f4-91c1-4384-b88a-5866ca150aea on hv-cinder-85221 Sep 01 14:09:40.442137 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [req-30956efe-d164-4ef0-87d1-c869522268af req-3d75c44d-14ad-49d3-9041-a4dae7460e49 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082511 Sep 01 14:09:40.442769 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 217/452] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:09:40.897363 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-7264a876-3855-4185-bd04-70cc000a3783 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:40.899388 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-7264a876-3855-4185-bd04-70cc000a3783 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:40.929758 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7264a876-3855-4185-bd04-70cc000a3783 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:40.937551 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-ed04e929-4191-4896-bcbf-c97aa9c9400e tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd44f175-c610-42a0-a6ea-1cfa6fe46ed6", "device": "/dev/sdb"}} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:09:40.942024 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-ed04e929-4191-4896-bcbf-c97aa9c9400e tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 81fe7593-66bc-442e-bd42-67dbb727a356] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:40.942288 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7264a876-3855-4185-bd04-70cc000a3783 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:40.943044 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7264a876-3855-4185-bd04-70cc000a3783 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:40.944062 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7264a876-3855-4185-bd04-70cc000a3783 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:40.944771 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7264a876-3855-4185-bd04-70cc000a3783 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:40.946646 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7264a876-3855-4185-bd04-70cc000a3783 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:40.966666 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ed04e929-4191-4896-bcbf-c97aa9c9400e tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:40.969299 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ed04e929-4191-4896-bcbf-c97aa9c9400e tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:40.971858 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ed04e929-4191-4896-bcbf-c97aa9c9400e tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:40.972831 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ed04e929-4191-4896-bcbf-c97aa9c9400e tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:40.973573 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ed04e929-4191-4896-bcbf-c97aa9c9400e tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:40.974349 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ed04e929-4191-4896-bcbf-c97aa9c9400e tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:41.324051 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell0:SELECT=14 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:41.572690 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-7264a876-3855-4185-bd04-70cc000a3783 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:41.590730 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-7264a876-3855-4185-bd04-70cc000a3783 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1259 microversion: 2.1 time: 0.698281 Sep 01 14:09:41.591425 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 236/453] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:40 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1259 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:09:41.602738 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-fc95ca71-716a-4647-a57f-1933c74ea92b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:41.615922 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-fc95ca71-716a-4647-a57f-1933c74ea92b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 3e82006c-11f2-43d8-b929-e161f9c506d4] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:41.640218 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-fc95ca71-716a-4647-a57f-1933c74ea92b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:41.640941 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-fc95ca71-716a-4647-a57f-1933c74ea92b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:41.641804 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-fc95ca71-716a-4647-a57f-1933c74ea92b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:41.643650 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-fc95ca71-716a-4647-a57f-1933c74ea92b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:41.644399 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-fc95ca71-716a-4647-a57f-1933c74ea92b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:41.645165 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-fc95ca71-716a-4647-a57f-1933c74ea92b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:42.028427 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-fc95ca71-716a-4647-a57f-1933c74ea92b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:42.041063 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-fc95ca71-716a-4647-a57f-1933c74ea92b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4" status: 200 len: 1366 microversion: 2.1 time: 0.442076 Sep 01 14:09:42.057213 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 237/454] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:41 2022] GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4 => generated 1366 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:42.062808 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [req-54567f37-7029-4f96-9587-3644babc2308 req-ef9e4597-3238-4b54-b163-fda824128291 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e82006c-11f2-43d8-b929-e161f9c506d4", "tag": "69252b21-42c1-4d12-b172-3cdc7e0d6d6b"}]} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:09:42.074428 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-54567f37-7029-4f96-9587-3644babc2308 req-ef9e4597-3238-4b54-b163-fda824128291 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:42.075618 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-54567f37-7029-4f96-9587-3644babc2308 req-ef9e4597-3238-4b54-b163-fda824128291 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:42.076222 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-54567f37-7029-4f96-9587-3644babc2308 req-ef9e4597-3238-4b54-b163-fda824128291 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:42.092271 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.compute.server_external_events [req-54567f37-7029-4f96-9587-3644babc2308 req-ef9e4597-3238-4b54-b163-fda824128291 service nova] Creating event network-changed:69252b21-42c1-4d12-b172-3cdc7e0d6d6b for instance 3e82006c-11f2-43d8-b929-e161f9c506d4 on hv-cinder-85221 Sep 01 14:09:42.105353 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [req-54567f37-7029-4f96-9587-3644babc2308 req-ef9e4597-3238-4b54-b163-fda824128291 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045336 Sep 01 14:09:42.107358 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 238/455] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:09:42.509758 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-ed04e929-4191-4896-bcbf-c97aa9c9400e tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "POST /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.577306 Sep 01 14:09:42.511132 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 218/456] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Sep 1 14:09:40 2022] POST /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356/os-volume_attachments => generated 194 bytes in 1580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:09:42.618175 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-2dea2f1c-1196-4406-bd80-d83d45d6971a tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:42.619478 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-2dea2f1c-1196-4406-bd80-d83d45d6971a tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:42.632545 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2dea2f1c-1196-4406-bd80-d83d45d6971a tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:42.633176 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2dea2f1c-1196-4406-bd80-d83d45d6971a tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:42.633723 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2dea2f1c-1196-4406-bd80-d83d45d6971a tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:42.634777 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2dea2f1c-1196-4406-bd80-d83d45d6971a tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:42.635482 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2dea2f1c-1196-4406-bd80-d83d45d6971a tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:42.636325 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2dea2f1c-1196-4406-bd80-d83d45d6971a tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:42.656611 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell1:SELECT=100 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:42.870142 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-2dea2f1c-1196-4406-bd80-d83d45d6971a tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:42.882522 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-2dea2f1c-1196-4406-bd80-d83d45d6971a tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1259 microversion: 2.1 time: 0.270855 Sep 01 14:09:42.894764 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 239/457] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:42 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1259 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:43.071174 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-866117e8-9c66-42c3-9449-ed7ce4ed8c17 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:43.073292 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-866117e8-9c66-42c3-9449-ed7ce4ed8c17 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 3e82006c-11f2-43d8-b929-e161f9c506d4] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:43.088736 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-866117e8-9c66-42c3-9449-ed7ce4ed8c17 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:43.090049 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-866117e8-9c66-42c3-9449-ed7ce4ed8c17 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:43.092815 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-866117e8-9c66-42c3-9449-ed7ce4ed8c17 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:43.093701 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-866117e8-9c66-42c3-9449-ed7ce4ed8c17 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:43.094917 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-866117e8-9c66-42c3-9449-ed7ce4ed8c17 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:43.097134 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-866117e8-9c66-42c3-9449-ed7ce4ed8c17 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:43.469263 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-866117e8-9c66-42c3-9449-ed7ce4ed8c17 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:43.493132 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-866117e8-9c66-42c3-9449-ed7ce4ed8c17 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4" status: 200 len: 1366 microversion: 2.1 time: 0.430753 Sep 01 14:09:43.508263 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 219/458] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:43 2022] GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4 => generated 1366 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:43.907261 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-15dc47c6-1531-4c7a-b1e9-6867335b9235 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:43.908663 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-15dc47c6-1531-4c7a-b1e9-6867335b9235 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:43.933078 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-15dc47c6-1531-4c7a-b1e9-6867335b9235 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:43.933689 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-15dc47c6-1531-4c7a-b1e9-6867335b9235 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:43.934387 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-15dc47c6-1531-4c7a-b1e9-6867335b9235 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:43.935399 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-15dc47c6-1531-4c7a-b1e9-6867335b9235 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:43.936359 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-15dc47c6-1531-4c7a-b1e9-6867335b9235 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:43.937189 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-15dc47c6-1531-4c7a-b1e9-6867335b9235 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:44.148746 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-15dc47c6-1531-4c7a-b1e9-6867335b9235 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:44.164955 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-15dc47c6-1531-4c7a-b1e9-6867335b9235 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1259 microversion: 2.1 time: 0.262469 Sep 01 14:09:44.180165 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 240/459] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:43 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1259 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:09:44.528500 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-46dc9930-7439-4e30-aefd-9434af86cc7d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:44.529841 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-46dc9930-7439-4e30-aefd-9434af86cc7d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 3e82006c-11f2-43d8-b929-e161f9c506d4] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:44.542015 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-46dc9930-7439-4e30-aefd-9434af86cc7d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:44.546823 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-46dc9930-7439-4e30-aefd-9434af86cc7d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:44.548250 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-46dc9930-7439-4e30-aefd-9434af86cc7d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:44.550794 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-46dc9930-7439-4e30-aefd-9434af86cc7d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:44.551950 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-46dc9930-7439-4e30-aefd-9434af86cc7d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:44.553122 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-46dc9930-7439-4e30-aefd-9434af86cc7d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:44.917168 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-46dc9930-7439-4e30-aefd-9434af86cc7d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:44.917168 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-46dc9930-7439-4e30-aefd-9434af86cc7d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4" status: 200 len: 1366 microversion: 2.1 time: 0.308861 Sep 01 14:09:44.917168 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 220/460] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:44 2022] GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4 => generated 1366 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:45.192820 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-12a81112-c069-4b9d-aee7-3fa902893902 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:45.193657 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-12a81112-c069-4b9d-aee7-3fa902893902 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:45.208355 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-12a81112-c069-4b9d-aee7-3fa902893902 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:45.210098 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-12a81112-c069-4b9d-aee7-3fa902893902 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:45.213102 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-12a81112-c069-4b9d-aee7-3fa902893902 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:45.213379 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-12a81112-c069-4b9d-aee7-3fa902893902 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:45.216495 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-12a81112-c069-4b9d-aee7-3fa902893902 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:45.217187 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-12a81112-c069-4b9d-aee7-3fa902893902 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:45.847785 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-04d8353e-0f88-4e37-9975-8bc430c21160 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:45.848731 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-04d8353e-0f88-4e37-9975-8bc430c21160 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 3e82006c-11f2-43d8-b929-e161f9c506d4] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:45.851618 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-12a81112-c069-4b9d-aee7-3fa902893902 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:45.856174 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-04d8353e-0f88-4e37-9975-8bc430c21160 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:45.856699 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-04d8353e-0f88-4e37-9975-8bc430c21160 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:45.857353 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-04d8353e-0f88-4e37-9975-8bc430c21160 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:45.858344 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-04d8353e-0f88-4e37-9975-8bc430c21160 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:45.858986 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-04d8353e-0f88-4e37-9975-8bc430c21160 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:45.859774 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-04d8353e-0f88-4e37-9975-8bc430c21160 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:45.877016 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-12a81112-c069-4b9d-aee7-3fa902893902 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1259 microversion: 2.1 time: 0.688301 Sep 01 14:09:45.898973 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 241/461] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:45 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1259 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:09:46.161467 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-04d8353e-0f88-4e37-9975-8bc430c21160 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:46.170995 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-04d8353e-0f88-4e37-9975-8bc430c21160 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4" status: 200 len: 1366 microversion: 2.1 time: 0.327996 Sep 01 14:09:46.171588 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 221/462] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:45 2022] GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4 => generated 1366 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:09:46.920008 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-18c43821-ac16-46cc-9056-ef84515fa626 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:46.921294 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-18c43821-ac16-46cc-9056-ef84515fa626 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:46.938620 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-18c43821-ac16-46cc-9056-ef84515fa626 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:46.940523 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-18c43821-ac16-46cc-9056-ef84515fa626 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:46.941576 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-18c43821-ac16-46cc-9056-ef84515fa626 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:46.942098 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-18c43821-ac16-46cc-9056-ef84515fa626 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:46.942920 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-18c43821-ac16-46cc-9056-ef84515fa626 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:46.943916 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-18c43821-ac16-46cc-9056-ef84515fa626 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:47.197123 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-18c43821-ac16-46cc-9056-ef84515fa626 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:47.207057 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-29ab63d8-68e8-4088-853b-9a3745f34756 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:47.211852 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-29ab63d8-68e8-4088-853b-9a3745f34756 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 3e82006c-11f2-43d8-b929-e161f9c506d4] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:47.228704 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-18c43821-ac16-46cc-9056-ef84515fa626 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1259 microversion: 2.1 time: 0.313648 Sep 01 14:09:47.233168 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-29ab63d8-68e8-4088-853b-9a3745f34756 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:47.233981 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-29ab63d8-68e8-4088-853b-9a3745f34756 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:47.235335 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 242/463] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:46 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1259 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:47.235710 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-29ab63d8-68e8-4088-853b-9a3745f34756 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:47.237202 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-29ab63d8-68e8-4088-853b-9a3745f34756 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:47.238133 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-29ab63d8-68e8-4088-853b-9a3745f34756 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:47.239441 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-29ab63d8-68e8-4088-853b-9a3745f34756 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:47.425917 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-29ab63d8-68e8-4088-853b-9a3745f34756 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:47.435481 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-29ab63d8-68e8-4088-853b-9a3745f34756 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4" status: 200 len: 1366 microversion: 2.1 time: 0.245587 Sep 01 14:09:47.436706 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 222/464] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:47 2022] GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4 => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:48.264957 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-2d8fd99a-12e5-41e5-a2cb-c3419c038cf8 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:48.265977 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-2d8fd99a-12e5-41e5-a2cb-c3419c038cf8 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:48.281440 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2d8fd99a-12e5-41e5-a2cb-c3419c038cf8 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:48.283549 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2d8fd99a-12e5-41e5-a2cb-c3419c038cf8 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:48.284333 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2d8fd99a-12e5-41e5-a2cb-c3419c038cf8 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:48.285639 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2d8fd99a-12e5-41e5-a2cb-c3419c038cf8 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:48.286514 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2d8fd99a-12e5-41e5-a2cb-c3419c038cf8 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:48.287283 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2d8fd99a-12e5-41e5-a2cb-c3419c038cf8 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:48.458562 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-9153d908-4862-4767-b0ea-2f5968b0a065 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:48.459914 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-9153d908-4862-4767-b0ea-2f5968b0a065 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 3e82006c-11f2-43d8-b929-e161f9c506d4] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:48.463445 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:48.479587 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9153d908-4862-4767-b0ea-2f5968b0a065 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:48.480782 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9153d908-4862-4767-b0ea-2f5968b0a065 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:48.482059 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9153d908-4862-4767-b0ea-2f5968b0a065 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:48.485297 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9153d908-4862-4767-b0ea-2f5968b0a065 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:48.486702 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9153d908-4862-4767-b0ea-2f5968b0a065 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:48.489612 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9153d908-4862-4767-b0ea-2f5968b0a065 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:48.570716 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-2d8fd99a-12e5-41e5-a2cb-c3419c038cf8 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:48.585697 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-2d8fd99a-12e5-41e5-a2cb-c3419c038cf8 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1259 microversion: 2.1 time: 0.327521 Sep 01 14:09:48.588683 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 243/465] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:48 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1259 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:48.800294 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-9153d908-4862-4767-b0ea-2f5968b0a065 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:48.809875 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-9153d908-4862-4767-b0ea-2f5968b0a065 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4" status: 200 len: 1366 microversion: 2.1 time: 0.355855 Sep 01 14:09:48.810855 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 223/466] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:48 2022] GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4 => generated 1366 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:48.837683 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-8cc7fe6d-b365-4998-b29a-f96364b6301a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:48.838235 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-8cc7fe6d-b365-4998-b29a-f96364b6301a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:48.845406 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8cc7fe6d-b365-4998-b29a-f96364b6301a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:48.846775 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8cc7fe6d-b365-4998-b29a-f96364b6301a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:48.847240 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8cc7fe6d-b365-4998-b29a-f96364b6301a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:48.847994 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8cc7fe6d-b365-4998-b29a-f96364b6301a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:48.848488 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8cc7fe6d-b365-4998-b29a-f96364b6301a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:48.848918 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8cc7fe6d-b365-4998-b29a-f96364b6301a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:49.026894 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.objects.instance [None req-8cc7fe6d-b365-4998-b29a-f96364b6301a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lazy-loading 'services' on Instance uuid 1c2b8351-0db7-45ab-848a-1e339e67bcf7 {{(pid=121340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:09:49.609572 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-b1b8cc6c-452d-4cb7-9a67-78b1f7c4bb62 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:49.610325 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-b1b8cc6c-452d-4cb7-9a67-78b1f7c4bb62 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:49.618468 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b1b8cc6c-452d-4cb7-9a67-78b1f7c4bb62 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:49.618970 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b1b8cc6c-452d-4cb7-9a67-78b1f7c4bb62 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:49.619414 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b1b8cc6c-452d-4cb7-9a67-78b1f7c4bb62 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:49.620151 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b1b8cc6c-452d-4cb7-9a67-78b1f7c4bb62 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:49.620617 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b1b8cc6c-452d-4cb7-9a67-78b1f7c4bb62 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:49.621053 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b1b8cc6c-452d-4cb7-9a67-78b1f7c4bb62 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:49.698497 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-8cc7fe6d-b365-4998-b29a-f96364b6301a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7/os-volume_attachments/8eb71d4b-9a62-40ff-a96f-cdb5eb7624e5" status: 202 len: 0 microversion: 2.1 time: 0.865391 Sep 01 14:09:49.702915 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 244/467] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Sep 1 14:09:48 2022] DELETE /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7/os-volume_attachments/8eb71d4b-9a62-40ff-a96f-cdb5eb7624e5 => generated 0 bytes in 871 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:09:49.851869 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-a2fb607e-03f0-4370-a76f-293769de8d0e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:49.853760 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-a2fb607e-03f0-4370-a76f-293769de8d0e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 3e82006c-11f2-43d8-b929-e161f9c506d4] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:49.863603 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a2fb607e-03f0-4370-a76f-293769de8d0e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:49.864598 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a2fb607e-03f0-4370-a76f-293769de8d0e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:49.865283 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a2fb607e-03f0-4370-a76f-293769de8d0e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:49.866453 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a2fb607e-03f0-4370-a76f-293769de8d0e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:49.867469 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a2fb607e-03f0-4370-a76f-293769de8d0e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:49.868226 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a2fb607e-03f0-4370-a76f-293769de8d0e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:49.872160 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-b1b8cc6c-452d-4cb7-9a67-78b1f7c4bb62 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:49.885666 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-b1b8cc6c-452d-4cb7-9a67-78b1f7c4bb62 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1259 microversion: 2.1 time: 0.280025 Sep 01 14:09:49.889058 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 224/468] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:49 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1259 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:09:50.122763 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-a2fb607e-03f0-4370-a76f-293769de8d0e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:50.131118 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [req-5c2360e4-a3c4-4cc0-a0e8-7cbd96cc5a82 req-8661ae71-2e24-4bb2-8e4a-bcaccb06fce0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e82006c-11f2-43d8-b929-e161f9c506d4", "name": "network-vif-plugged", "status": "completed", "tag": "69252b21-42c1-4d12-b172-3cdc7e0d6d6b"}]} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:09:50.143681 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-a2fb607e-03f0-4370-a76f-293769de8d0e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4" status: 200 len: 1366 microversion: 2.1 time: 0.301481 Sep 01 14:09:50.146155 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 245/469] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:49 2022] GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4 => generated 1366 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:09:50.150498 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-5c2360e4-a3c4-4cc0-a0e8-7cbd96cc5a82 req-8661ae71-2e24-4bb2-8e4a-bcaccb06fce0 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:50.151264 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-5c2360e4-a3c4-4cc0-a0e8-7cbd96cc5a82 req-8661ae71-2e24-4bb2-8e4a-bcaccb06fce0 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:50.151774 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-5c2360e4-a3c4-4cc0-a0e8-7cbd96cc5a82 req-8661ae71-2e24-4bb2-8e4a-bcaccb06fce0 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:50.196096 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.compute.server_external_events [req-5c2360e4-a3c4-4cc0-a0e8-7cbd96cc5a82 req-8661ae71-2e24-4bb2-8e4a-bcaccb06fce0 service nova] Creating event network-vif-plugged:69252b21-42c1-4d12-b172-3cdc7e0d6d6b for instance 3e82006c-11f2-43d8-b929-e161f9c506d4 on hv-cinder-85221 Sep 01 14:09:50.204455 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [req-5c2360e4-a3c4-4cc0-a0e8-7cbd96cc5a82 req-8661ae71-2e24-4bb2-8e4a-bcaccb06fce0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077178 Sep 01 14:09:50.206334 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 225/470] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:09:50.921887 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-c653fa44-1bf0-45b8-8b8c-ef2684b30c2c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:50.924742 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-c653fa44-1bf0-45b8-8b8c-ef2684b30c2c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:50.945610 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c653fa44-1bf0-45b8-8b8c-ef2684b30c2c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:50.946916 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c653fa44-1bf0-45b8-8b8c-ef2684b30c2c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:50.947989 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c653fa44-1bf0-45b8-8b8c-ef2684b30c2c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:50.949162 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c653fa44-1bf0-45b8-8b8c-ef2684b30c2c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:50.965104 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c653fa44-1bf0-45b8-8b8c-ef2684b30c2c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:50.965104 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c653fa44-1bf0-45b8-8b8c-ef2684b30c2c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:51.206712 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-206d77ad-c738-4983-a420-4a29052c990d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:51.214342 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-206d77ad-c738-4983-a420-4a29052c990d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 3e82006c-11f2-43d8-b929-e161f9c506d4] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:51.227526 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-c653fa44-1bf0-45b8-8b8c-ef2684b30c2c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:51.242850 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-206d77ad-c738-4983-a420-4a29052c990d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:51.246326 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-c653fa44-1bf0-45b8-8b8c-ef2684b30c2c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1259 microversion: 2.1 time: 0.331456 Sep 01 14:09:51.246762 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-206d77ad-c738-4983-a420-4a29052c990d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:51.247787 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 246/471] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:50 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1259 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:09:51.249505 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-206d77ad-c738-4983-a420-4a29052c990d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:51.251275 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-206d77ad-c738-4983-a420-4a29052c990d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:51.253003 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-206d77ad-c738-4983-a420-4a29052c990d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:51.254143 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-206d77ad-c738-4983-a420-4a29052c990d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:51.690702 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-206d77ad-c738-4983-a420-4a29052c990d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:51.732951 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-206d77ad-c738-4983-a420-4a29052c990d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4" status: 200 len: 1366 microversion: 2.1 time: 0.546240 Sep 01 14:09:51.735118 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 226/472] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:51 2022] GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4 => generated 1366 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:52.269671 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-8bc8fb3e-cd17-4a88-a05e-9fbea5023f06 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:52.270273 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-8bc8fb3e-cd17-4a88-a05e-9fbea5023f06 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:52.278073 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8bc8fb3e-cd17-4a88-a05e-9fbea5023f06 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:52.278987 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8bc8fb3e-cd17-4a88-a05e-9fbea5023f06 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:52.279758 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8bc8fb3e-cd17-4a88-a05e-9fbea5023f06 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:52.280516 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8bc8fb3e-cd17-4a88-a05e-9fbea5023f06 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:52.280986 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8bc8fb3e-cd17-4a88-a05e-9fbea5023f06 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:52.282591 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8bc8fb3e-cd17-4a88-a05e-9fbea5023f06 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:52.479441 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-8bc8fb3e-cd17-4a88-a05e-9fbea5023f06 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:52.489424 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-8bc8fb3e-cd17-4a88-a05e-9fbea5023f06 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1259 microversion: 2.1 time: 0.223770 Sep 01 14:09:52.500545 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 247/473] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:52 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1259 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:52.775691 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-1e9c7b08-fbc1-4ea9-96b4-f042c01e628a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:52.776785 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-1e9c7b08-fbc1-4ea9-96b4-f042c01e628a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 3e82006c-11f2-43d8-b929-e161f9c506d4] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:52.792699 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1e9c7b08-fbc1-4ea9-96b4-f042c01e628a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:52.793876 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1e9c7b08-fbc1-4ea9-96b4-f042c01e628a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:52.794716 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1e9c7b08-fbc1-4ea9-96b4-f042c01e628a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:52.795770 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1e9c7b08-fbc1-4ea9-96b4-f042c01e628a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:52.796706 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1e9c7b08-fbc1-4ea9-96b4-f042c01e628a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:52.798018 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1e9c7b08-fbc1-4ea9-96b4-f042c01e628a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:53.062616 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-1e9c7b08-fbc1-4ea9-96b4-f042c01e628a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:53.071968 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-1e9c7b08-fbc1-4ea9-96b4-f042c01e628a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4" status: 200 len: 1366 microversion: 2.1 time: 0.302813 Sep 01 14:09:53.073060 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 227/474] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:52 2022] GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4 => generated 1366 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:53.511280 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-b24e6ffe-34c6-4132-8122-75af7af0ee6c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:53.511911 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-b24e6ffe-34c6-4132-8122-75af7af0ee6c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:53.519211 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b24e6ffe-34c6-4132-8122-75af7af0ee6c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:53.520026 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b24e6ffe-34c6-4132-8122-75af7af0ee6c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:53.520466 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b24e6ffe-34c6-4132-8122-75af7af0ee6c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:53.521252 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b24e6ffe-34c6-4132-8122-75af7af0ee6c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:53.521613 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b24e6ffe-34c6-4132-8122-75af7af0ee6c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:53.522108 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b24e6ffe-34c6-4132-8122-75af7af0ee6c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:53.688548 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-b24e6ffe-34c6-4132-8122-75af7af0ee6c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:53.698375 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-b24e6ffe-34c6-4132-8122-75af7af0ee6c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1259 microversion: 2.1 time: 0.190195 Sep 01 14:09:53.698375 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 248/475] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:53 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1259 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:09:54.104695 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-74406f9a-7712-4807-95a7-e3e9afc92390 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:54.109528 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-74406f9a-7712-4807-95a7-e3e9afc92390 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 3e82006c-11f2-43d8-b929-e161f9c506d4] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:54.123831 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-74406f9a-7712-4807-95a7-e3e9afc92390 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:54.124206 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-74406f9a-7712-4807-95a7-e3e9afc92390 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:54.128544 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-74406f9a-7712-4807-95a7-e3e9afc92390 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:54.129341 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-74406f9a-7712-4807-95a7-e3e9afc92390 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:54.129817 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-74406f9a-7712-4807-95a7-e3e9afc92390 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:54.130279 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-74406f9a-7712-4807-95a7-e3e9afc92390 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:54.257269 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [req-7b44f80d-26f2-4b93-9821-e22a1e8e5e86 req-5d13f808-82db-4ba6-b4c1-167233ab33cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cc866f4-91c1-4384-b88a-5866ca150aea", "name": "network-vif-plugged", "status": "completed", "tag": "9b44c940-faa5-4df3-83f2-2d676ad70287"}]} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:09:54.278728 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-7b44f80d-26f2-4b93-9821-e22a1e8e5e86 req-5d13f808-82db-4ba6-b4c1-167233ab33cd service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:54.279261 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-7b44f80d-26f2-4b93-9821-e22a1e8e5e86 req-5d13f808-82db-4ba6-b4c1-167233ab33cd service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:54.280094 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-7b44f80d-26f2-4b93-9821-e22a1e8e5e86 req-5d13f808-82db-4ba6-b4c1-167233ab33cd service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:54.297391 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.compute.server_external_events [req-7b44f80d-26f2-4b93-9821-e22a1e8e5e86 req-5d13f808-82db-4ba6-b4c1-167233ab33cd service nova] Creating event network-vif-plugged:9b44c940-faa5-4df3-83f2-2d676ad70287 for instance 3cc866f4-91c1-4384-b88a-5866ca150aea on hv-cinder-85221 Sep 01 14:09:54.306347 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [req-7b44f80d-26f2-4b93-9821-e22a1e8e5e86 req-5d13f808-82db-4ba6-b4c1-167233ab33cd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052716 Sep 01 14:09:54.308081 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 249/476] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:09:54.328734 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-6c5755e0-a53a-449d-aaa7-0b9d9dc708af tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:09:54.350716 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6c5755e0-a53a-449d-aaa7-0b9d9dc708af tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:54.351277 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6c5755e0-a53a-449d-aaa7-0b9d9dc708af tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:54.351732 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6c5755e0-a53a-449d-aaa7-0b9d9dc708af tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:54.378877 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-74406f9a-7712-4807-95a7-e3e9afc92390 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:54.380235 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-6c5755e0-a53a-449d-aaa7-0b9d9dc708af tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Going to try to stop instance {{(pid=121340) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 01 14:09:54.391265 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-74406f9a-7712-4807-95a7-e3e9afc92390 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4" status: 200 len: 1556 microversion: 2.1 time: 0.290524 Sep 01 14:09:54.407529 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 228/477] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:54 2022] GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4 => generated 1556 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:54.415338 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-ddcbd69e-9ebf-4b09-9051-c75fbfcc5c5f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:54.417008 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-ddcbd69e-9ebf-4b09-9051-c75fbfcc5c5f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 3e82006c-11f2-43d8-b929-e161f9c506d4] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:54.424139 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ddcbd69e-9ebf-4b09-9051-c75fbfcc5c5f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:54.425070 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ddcbd69e-9ebf-4b09-9051-c75fbfcc5c5f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:54.425675 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ddcbd69e-9ebf-4b09-9051-c75fbfcc5c5f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:54.426615 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ddcbd69e-9ebf-4b09-9051-c75fbfcc5c5f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:54.427270 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ddcbd69e-9ebf-4b09-9051-c75fbfcc5c5f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:54.427981 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ddcbd69e-9ebf-4b09-9051-c75fbfcc5c5f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:54.578106 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-ddcbd69e-9ebf-4b09-9051-c75fbfcc5c5f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.166536 Sep 01 14:09:54.579262 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 229/478] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Sep 1 14:09:54 2022] GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4/os-interface => generated 284 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:09:54.720224 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-3a5bbd77-5a32-4631-947e-3c566069bf54 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:54.720821 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-3a5bbd77-5a32-4631-947e-3c566069bf54 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:54.727364 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3a5bbd77-5a32-4631-947e-3c566069bf54 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:54.727859 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3a5bbd77-5a32-4631-947e-3c566069bf54 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:54.728295 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3a5bbd77-5a32-4631-947e-3c566069bf54 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:54.729027 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3a5bbd77-5a32-4631-947e-3c566069bf54 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:54.729487 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3a5bbd77-5a32-4631-947e-3c566069bf54 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:54.729940 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3a5bbd77-5a32-4631-947e-3c566069bf54 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:54.892729 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-3a5bbd77-5a32-4631-947e-3c566069bf54 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:54.900142 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-6c5755e0-a53a-449d-aaa7-0b9d9dc708af tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "POST /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7/action" status: 202 len: 0 microversion: 2.1 time: 0.575340 Sep 01 14:09:54.906493 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 250/479] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Sep 1 14:09:54 2022] POST /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7/action => generated 0 bytes in 581 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 14:09:54.906945 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-3a5bbd77-5a32-4631-947e-3c566069bf54 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1259 microversion: 2.1 time: 0.190440 Sep 01 14:09:54.911666 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-251a7eb1-a158-4ae3-9798-7af2bc2941fb tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:54.912704 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-251a7eb1-a158-4ae3-9798-7af2bc2941fb tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:54.919686 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-251a7eb1-a158-4ae3-9798-7af2bc2941fb tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:54.920540 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-251a7eb1-a158-4ae3-9798-7af2bc2941fb tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:54.921215 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-251a7eb1-a158-4ae3-9798-7af2bc2941fb tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:54.922173 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-251a7eb1-a158-4ae3-9798-7af2bc2941fb tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:54.922813 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-251a7eb1-a158-4ae3-9798-7af2bc2941fb tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:54.922970 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 230/480] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:54 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1259 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:54.924100 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-251a7eb1-a158-4ae3-9798-7af2bc2941fb tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:55.094971 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-251a7eb1-a158-4ae3-9798-7af2bc2941fb tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:55.105759 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-251a7eb1-a158-4ae3-9798-7af2bc2941fb tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1678 microversion: 2.1 time: 0.199565 Sep 01 14:09:55.106388 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 251/481] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:54 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1678 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:55.324634 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-a7df7cc6-b3f3-4b5b-9574-f55f4f4cfe29 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Action: 'create', calling method: .version_select at 0x7f9867ba4700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2074330713", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkyOdI3+mtkxvz1+5cB4o2t8LpzCN1j/Gm4Kvlg4aR6sX9GPUrEnArBeALdf8MSw3FqXJsrC/LVh+PmhPqaQXEjF/Azch1/rlqBEoWq5hC+yhtYTKg+UM9yuPyRYVgyHg=="}} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:09:55.354580 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.quota [None req-a7df7cc6-b3f3-4b5b-9574-f55f4f4cfe29 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Getting quotas for project adf6f1699a0740ee99ae03ef2423d143. Resources: {'key_pairs'} {{(pid=121339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:09:55.362888 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.quota [None req-a7df7cc6-b3f3-4b5b-9574-f55f4f4cfe29 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Getting quotas for user 77b0f8fe6dde4842bb3d03150ebe9916 and project adf6f1699a0740ee99ae03ef2423d143. Resources: {'key_pairs'} {{(pid=121339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:09:55.473677 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-a7df7cc6-b3f3-4b5b-9574-f55f4f4cfe29 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.156730 Sep 01 14:09:55.478105 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 231/482] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Sep 1 14:09:55 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:09:55.536910 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-1441f0d6-031e-4fe8-b201-253c186ef2e8 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-399446848", "imageRef": "bfb9137e-bcf4-4fce-91ed-e26fdb4d3d15", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2074330713", "networks": [{"uuid": "52d2108a-679f-4e17-b63b-779cfbdc360f"}]}} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:09:55.610653 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.network.neutron [None req-1441f0d6-031e-4fe8-b201-253c186ef2e8 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] validate_networks() for [('52d2108a-679f-4e17-b63b-779cfbdc360f', None, None, None, None, None)] {{(pid=121340) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:09:55.942937 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-a8a8220c-d8db-4612-b701-7657398db826 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:55.944508 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-a8a8220c-d8db-4612-b701-7657398db826 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:55.951811 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a8a8220c-d8db-4612-b701-7657398db826 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:55.952390 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a8a8220c-d8db-4612-b701-7657398db826 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:55.952934 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a8a8220c-d8db-4612-b701-7657398db826 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:55.953741 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a8a8220c-d8db-4612-b701-7657398db826 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:55.955014 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a8a8220c-d8db-4612-b701-7657398db826 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:55.955526 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a8a8220c-d8db-4612-b701-7657398db826 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:56.146401 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-1441f0d6-031e-4fe8-b201-253c186ef2e8 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Flavor limits 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:09:56.146401 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-1441f0d6-031e-4fe8-b201-253c186ef2e8 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Image limits 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:09:56.146401 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-1441f0d6-031e-4fe8-b201-253c186ef2e8 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Flavor pref 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:09:56.150064 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-1441f0d6-031e-4fe8-b201-253c186ef2e8 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Image pref 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:09:56.150064 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-1441f0d6-031e-4fe8-b201-253c186ef2e8 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:09:56.158183 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1441f0d6-031e-4fe8-b201-253c186ef2e8 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:56.158800 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1441f0d6-031e-4fe8-b201-253c186ef2e8 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:56.159215 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1441f0d6-031e-4fe8-b201-253c186ef2e8 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:56.159991 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1441f0d6-031e-4fe8-b201-253c186ef2e8 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:56.160439 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1441f0d6-031e-4fe8-b201-253c186ef2e8 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:56.161093 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1441f0d6-031e-4fe8-b201-253c186ef2e8 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:56.184681 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.quota [None req-1441f0d6-031e-4fe8-b201-253c186ef2e8 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Getting quotas for project adf6f1699a0740ee99ae03ef2423d143. Resources: {'cores', 'instances', 'ram'} {{(pid=121340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:09:56.191399 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.quota [None req-1441f0d6-031e-4fe8-b201-253c186ef2e8 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Getting quotas for user 77b0f8fe6dde4842bb3d03150ebe9916 and project adf6f1699a0740ee99ae03ef2423d143. Resources: {'cores', 'instances', 'ram'} {{(pid=121340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:09:56.206789 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-a8a8220c-d8db-4612-b701-7657398db826 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:56.212741 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-1441f0d6-031e-4fe8-b201-253c186ef2e8 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Going to run 1 instances... {{(pid=121340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:09:56.215255 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-1441f0d6-031e-4fe8-b201-253c186ef2e8 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bfb9137e-bcf4-4fce-91ed-e26fdb4d3d15',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:09:56.217596 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-a8a8220c-d8db-4612-b701-7657398db826 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1259 microversion: 2.1 time: 0.280805 Sep 01 14:09:56.218322 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 232/483] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:55 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1259 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:09:56.237376 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-33710c2a-b20d-4a7d-8aeb-5357dcf27f98 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:56.238119 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-33710c2a-b20d-4a7d-8aeb-5357dcf27f98 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:56.244764 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-33710c2a-b20d-4a7d-8aeb-5357dcf27f98 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:56.245253 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-33710c2a-b20d-4a7d-8aeb-5357dcf27f98 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:56.245689 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-33710c2a-b20d-4a7d-8aeb-5357dcf27f98 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:56.246486 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-33710c2a-b20d-4a7d-8aeb-5357dcf27f98 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:56.246940 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-33710c2a-b20d-4a7d-8aeb-5357dcf27f98 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:56.247357 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-33710c2a-b20d-4a7d-8aeb-5357dcf27f98 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:56.382846 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-1441f0d6-031e-4fe8-b201-253c186ef2e8 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.849726 Sep 01 14:09:56.384267 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 252/484] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 1 14:09:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 14:09:56.389352 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [req-16545000-c119-4351-a1cb-17bf7e63dbf6 req-5f9bb85a-7c0b-4aba-befb-7a816fe62b78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e82006c-11f2-43d8-b929-e161f9c506d4", "tag": "69252b21-42c1-4d12-b172-3cdc7e0d6d6b"}]} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:09:56.401038 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-16545000-c119-4351-a1cb-17bf7e63dbf6 req-5f9bb85a-7c0b-4aba-befb-7a816fe62b78 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:56.403230 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-16545000-c119-4351-a1cb-17bf7e63dbf6 req-5f9bb85a-7c0b-4aba-befb-7a816fe62b78 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:56.403230 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-16545000-c119-4351-a1cb-17bf7e63dbf6 req-5f9bb85a-7c0b-4aba-befb-7a816fe62b78 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:56.406080 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-33710c2a-b20d-4a7d-8aeb-5357dcf27f98 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:56.417277 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.compute.server_external_events [req-16545000-c119-4351-a1cb-17bf7e63dbf6 req-5f9bb85a-7c0b-4aba-befb-7a816fe62b78 service nova] Creating event network-changed:69252b21-42c1-4d12-b172-3cdc7e0d6d6b for instance 3e82006c-11f2-43d8-b929-e161f9c506d4 on hv-cinder-85221 Sep 01 14:09:56.418640 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-33710c2a-b20d-4a7d-8aeb-5357dcf27f98 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1678 microversion: 2.1 time: 0.187236 Sep 01 14:09:56.419596 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 233/485] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:56 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1678 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:56.425350 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [req-16545000-c119-4351-a1cb-17bf7e63dbf6 req-5f9bb85a-7c0b-4aba-befb-7a816fe62b78 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039040 Sep 01 14:09:56.426641 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 253/486] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:09:56.438131 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-0a6e943c-887a-4d5c-8ab5-e3d94a9ba8d2 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:56.438607 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-0a6e943c-887a-4d5c-8ab5-e3d94a9ba8d2 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:56.511739 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-0a6e943c-887a-4d5c-8ab5-e3d94a9ba8d2 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:56.523770 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-0a6e943c-887a-4d5c-8ab5-e3d94a9ba8d2 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1258 microversion: 2.1 time: 0.102929 Sep 01 14:09:56.524447 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 234/487] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:56 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1258 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:57.248580 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-54034bea-212a-4056-a8ca-c74735bd616a tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:57.250101 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-54034bea-212a-4056-a8ca-c74735bd616a tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:57.263018 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-54034bea-212a-4056-a8ca-c74735bd616a tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:57.264318 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-54034bea-212a-4056-a8ca-c74735bd616a tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:57.265116 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-54034bea-212a-4056-a8ca-c74735bd616a tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:57.266496 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-54034bea-212a-4056-a8ca-c74735bd616a tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:57.279426 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-54034bea-212a-4056-a8ca-c74735bd616a tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:57.283033 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-54034bea-212a-4056-a8ca-c74735bd616a tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:57.457786 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-e284f62e-f3d4-4a83-8ec8-709d4c57292f tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:57.461780 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-e284f62e-f3d4-4a83-8ec8-709d4c57292f tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:57.471735 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e284f62e-f3d4-4a83-8ec8-709d4c57292f tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:57.472637 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e284f62e-f3d4-4a83-8ec8-709d4c57292f tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:57.473452 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e284f62e-f3d4-4a83-8ec8-709d4c57292f tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:57.474606 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e284f62e-f3d4-4a83-8ec8-709d4c57292f tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:57.475510 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e284f62e-f3d4-4a83-8ec8-709d4c57292f tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:57.476274 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e284f62e-f3d4-4a83-8ec8-709d4c57292f tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:57.512990 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-54034bea-212a-4056-a8ca-c74735bd616a tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:57.526003 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-54034bea-212a-4056-a8ca-c74735bd616a tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1259 microversion: 2.1 time: 0.282869 Sep 01 14:09:57.527736 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 254/488] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:57 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1259 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:09:57.579115 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-2bfee27d-5571-4c6c-b2a1-9e6ed267d8da tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:57.581128 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-2bfee27d-5571-4c6c-b2a1-9e6ed267d8da tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:57.658092 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-e284f62e-f3d4-4a83-8ec8-709d4c57292f tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:57.677042 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-e284f62e-f3d4-4a83-8ec8-709d4c57292f tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1678 microversion: 2.1 time: 0.228488 Sep 01 14:09:57.677788 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 235/489] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:57 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1678 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:57.702851 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-2bfee27d-5571-4c6c-b2a1-9e6ed267d8da tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:57.711850 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-2bfee27d-5571-4c6c-b2a1-9e6ed267d8da tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1258 microversion: 2.1 time: 0.165732 Sep 01 14:09:57.712547 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 255/490] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:57 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1258 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:58.556837 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-e12c8667-e95e-4918-ad40-9bb863308eef tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:58.559454 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-e12c8667-e95e-4918-ad40-9bb863308eef tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:58.571699 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e12c8667-e95e-4918-ad40-9bb863308eef tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:58.573052 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e12c8667-e95e-4918-ad40-9bb863308eef tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:58.574727 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e12c8667-e95e-4918-ad40-9bb863308eef tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:58.576316 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e12c8667-e95e-4918-ad40-9bb863308eef tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:58.577601 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e12c8667-e95e-4918-ad40-9bb863308eef tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:58.578665 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e12c8667-e95e-4918-ad40-9bb863308eef tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:58.592993 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:58.715122 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-0b06e1df-2084-4c8f-9c1b-135b8dd9da2b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:58.716463 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-0b06e1df-2084-4c8f-9c1b-135b8dd9da2b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:58.730916 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0b06e1df-2084-4c8f-9c1b-135b8dd9da2b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:58.731992 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0b06e1df-2084-4c8f-9c1b-135b8dd9da2b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:58.732819 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0b06e1df-2084-4c8f-9c1b-135b8dd9da2b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:58.733712 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0b06e1df-2084-4c8f-9c1b-135b8dd9da2b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:58.734412 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0b06e1df-2084-4c8f-9c1b-135b8dd9da2b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:58.735019 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0b06e1df-2084-4c8f-9c1b-135b8dd9da2b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:58.819180 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-e12c8667-e95e-4918-ad40-9bb863308eef tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:58.827608 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-e12c8667-e95e-4918-ad40-9bb863308eef tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1259 microversion: 2.1 time: 0.278703 Sep 01 14:09:58.828172 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 236/491] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:58 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1259 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:09:58.833222 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-63182748-2bcb-452f-a436-05b7aa5b4765 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:58.833829 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-63182748-2bcb-452f-a436-05b7aa5b4765 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:58.856789 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-63182748-2bcb-452f-a436-05b7aa5b4765 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:58.857505 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-63182748-2bcb-452f-a436-05b7aa5b4765 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:58.858107 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-63182748-2bcb-452f-a436-05b7aa5b4765 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:58.858672 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-63182748-2bcb-452f-a436-05b7aa5b4765 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:58.859120 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-63182748-2bcb-452f-a436-05b7aa5b4765 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:58.859555 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-63182748-2bcb-452f-a436-05b7aa5b4765 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:58.922637 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-0b06e1df-2084-4c8f-9c1b-135b8dd9da2b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:58.933040 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-0b06e1df-2084-4c8f-9c1b-135b8dd9da2b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1678 microversion: 2.1 time: 0.226114 Sep 01 14:09:58.934015 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 256/492] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:58 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1678 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:58.956678 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-63182748-2bcb-452f-a436-05b7aa5b4765 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:58.969043 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-63182748-2bcb-452f-a436-05b7aa5b4765 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1262 microversion: 2.1 time: 0.139552 Sep 01 14:09:58.969925 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 237/493] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:58 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1262 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:59.855300 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-bfa3e90e-dd42-47eb-8889-50e141b3f186 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:59.855883 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-bfa3e90e-dd42-47eb-8889-50e141b3f186 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:59.862992 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bfa3e90e-dd42-47eb-8889-50e141b3f186 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:59.863482 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bfa3e90e-dd42-47eb-8889-50e141b3f186 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:59.863917 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bfa3e90e-dd42-47eb-8889-50e141b3f186 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:59.864674 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bfa3e90e-dd42-47eb-8889-50e141b3f186 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:59.865151 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bfa3e90e-dd42-47eb-8889-50e141b3f186 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:59.865584 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bfa3e90e-dd42-47eb-8889-50e141b3f186 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:59.882856 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:59.956598 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-fa6b6853-2523-4c83-8b11-89c1bc51e3d9 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:59.958321 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-fa6b6853-2523-4c83-8b11-89c1bc51e3d9 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:59.964738 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fa6b6853-2523-4c83-8b11-89c1bc51e3d9 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:59.965603 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fa6b6853-2523-4c83-8b11-89c1bc51e3d9 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:59.965603 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fa6b6853-2523-4c83-8b11-89c1bc51e3d9 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:59.966371 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fa6b6853-2523-4c83-8b11-89c1bc51e3d9 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:59.966813 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fa6b6853-2523-4c83-8b11-89c1bc51e3d9 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:59.967226 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fa6b6853-2523-4c83-8b11-89c1bc51e3d9 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:00.031161 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-bfa3e90e-dd42-47eb-8889-50e141b3f186 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:00.040224 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-bfa3e90e-dd42-47eb-8889-50e141b3f186 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1259 microversion: 2.1 time: 0.189157 Sep 01 14:10:00.040877 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 257/494] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:59 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1259 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:00.045764 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-ec3a0885-5eeb-495a-a3c7-a9a16900b2ba tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:00.046416 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-ec3a0885-5eeb-495a-a3c7-a9a16900b2ba tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:00.053824 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ec3a0885-5eeb-495a-a3c7-a9a16900b2ba tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:00.054340 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ec3a0885-5eeb-495a-a3c7-a9a16900b2ba tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:00.054968 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ec3a0885-5eeb-495a-a3c7-a9a16900b2ba tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:00.055713 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ec3a0885-5eeb-495a-a3c7-a9a16900b2ba tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:00.056165 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ec3a0885-5eeb-495a-a3c7-a9a16900b2ba tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:00.056614 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ec3a0885-5eeb-495a-a3c7-a9a16900b2ba tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:00.141109 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-fa6b6853-2523-4c83-8b11-89c1bc51e3d9 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:00.150924 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-fa6b6853-2523-4c83-8b11-89c1bc51e3d9 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1678 microversion: 2.1 time: 0.198596 Sep 01 14:10:00.151749 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 238/495] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:59 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1678 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:10:00.161372 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-ec3a0885-5eeb-495a-a3c7-a9a16900b2ba tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:00.177356 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-ec3a0885-5eeb-495a-a3c7-a9a16900b2ba tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1254 microversion: 2.1 time: 0.134899 Sep 01 14:10:00.178068 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 258/496] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:00 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1254 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:01.079807 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-69981b19-1feb-44d8-8874-ce3ced9587e8 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:01.081483 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-69981b19-1feb-44d8-8874-ce3ced9587e8 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:01.093982 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-69981b19-1feb-44d8-8874-ce3ced9587e8 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:01.100774 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-69981b19-1feb-44d8-8874-ce3ced9587e8 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:01.100774 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-69981b19-1feb-44d8-8874-ce3ced9587e8 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:01.100774 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-69981b19-1feb-44d8-8874-ce3ced9587e8 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:01.100774 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-69981b19-1feb-44d8-8874-ce3ced9587e8 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:01.101302 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-69981b19-1feb-44d8-8874-ce3ced9587e8 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:01.186145 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-9553a17d-8cf6-4770-b55c-da37f273e58b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:01.187027 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-9553a17d-8cf6-4770-b55c-da37f273e58b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:01.195454 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9553a17d-8cf6-4770-b55c-da37f273e58b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:01.196294 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9553a17d-8cf6-4770-b55c-da37f273e58b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:01.196645 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9553a17d-8cf6-4770-b55c-da37f273e58b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:01.197379 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9553a17d-8cf6-4770-b55c-da37f273e58b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:01.197835 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9553a17d-8cf6-4770-b55c-da37f273e58b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:01.198300 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9553a17d-8cf6-4770-b55c-da37f273e58b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:01.352832 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-69981b19-1feb-44d8-8874-ce3ced9587e8 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:01.363312 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-69981b19-1feb-44d8-8874-ce3ced9587e8 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1259 microversion: 2.1 time: 0.291578 Sep 01 14:10:01.364083 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 239/497] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:01 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1259 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:01.370404 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-da53e172-25a2-45b1-87bb-e746e5dbe25a tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:01.371155 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-da53e172-25a2-45b1-87bb-e746e5dbe25a tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:01.380676 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-da53e172-25a2-45b1-87bb-e746e5dbe25a tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:01.381600 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-da53e172-25a2-45b1-87bb-e746e5dbe25a tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:01.382191 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-da53e172-25a2-45b1-87bb-e746e5dbe25a tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:01.383149 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-da53e172-25a2-45b1-87bb-e746e5dbe25a tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:01.383704 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-da53e172-25a2-45b1-87bb-e746e5dbe25a tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:01.384224 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-da53e172-25a2-45b1-87bb-e746e5dbe25a tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:01.401591 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-9553a17d-8cf6-4770-b55c-da37f273e58b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:01.413664 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-9553a17d-8cf6-4770-b55c-da37f273e58b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1678 microversion: 2.1 time: 0.231626 Sep 01 14:10:01.414667 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 259/498] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:01 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1678 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:10:01.480053 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-da53e172-25a2-45b1-87bb-e746e5dbe25a tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:01.494948 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-da53e172-25a2-45b1-87bb-e746e5dbe25a tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1254 microversion: 2.1 time: 0.129212 Sep 01 14:10:01.495991 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 240/499] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:01 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1254 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:02.400831 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-055e20a5-d502-4e4d-a5d1-fd012c9fc72d tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:02.401892 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-055e20a5-d502-4e4d-a5d1-fd012c9fc72d tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:02.409613 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-055e20a5-d502-4e4d-a5d1-fd012c9fc72d tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:02.410150 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-055e20a5-d502-4e4d-a5d1-fd012c9fc72d tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:02.410599 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-055e20a5-d502-4e4d-a5d1-fd012c9fc72d tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:02.411425 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-055e20a5-d502-4e4d-a5d1-fd012c9fc72d tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:02.411889 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-055e20a5-d502-4e4d-a5d1-fd012c9fc72d tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:02.412315 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-055e20a5-d502-4e4d-a5d1-fd012c9fc72d tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:02.462176 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-044b668d-5ddc-4e50-b308-ddad96f626de tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:02.463094 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-044b668d-5ddc-4e50-b308-ddad96f626de tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:02.480875 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-044b668d-5ddc-4e50-b308-ddad96f626de tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:02.483869 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-044b668d-5ddc-4e50-b308-ddad96f626de tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:02.483869 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-044b668d-5ddc-4e50-b308-ddad96f626de tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:02.483869 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-044b668d-5ddc-4e50-b308-ddad96f626de tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:02.483869 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-044b668d-5ddc-4e50-b308-ddad96f626de tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:02.484574 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-044b668d-5ddc-4e50-b308-ddad96f626de tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:02.660885 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-055e20a5-d502-4e4d-a5d1-fd012c9fc72d tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:02.672913 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-055e20a5-d502-4e4d-a5d1-fd012c9fc72d tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1259 microversion: 2.1 time: 0.279297 Sep 01 14:10:02.675141 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 260/500] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:02 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1259 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:02.683846 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-e9d2fa48-968a-4c52-967e-7ad3417d9f8e tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:02.685051 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-e9d2fa48-968a-4c52-967e-7ad3417d9f8e tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:02.698762 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e9d2fa48-968a-4c52-967e-7ad3417d9f8e tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:02.699704 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e9d2fa48-968a-4c52-967e-7ad3417d9f8e tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:02.700480 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e9d2fa48-968a-4c52-967e-7ad3417d9f8e tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:02.703880 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e9d2fa48-968a-4c52-967e-7ad3417d9f8e tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:02.703880 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e9d2fa48-968a-4c52-967e-7ad3417d9f8e tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:02.703880 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e9d2fa48-968a-4c52-967e-7ad3417d9f8e tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:02.723711 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-044b668d-5ddc-4e50-b308-ddad96f626de tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:02.733513 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-044b668d-5ddc-4e50-b308-ddad96f626de tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1678 microversion: 2.1 time: 0.288713 Sep 01 14:10:02.734965 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 241/501] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:02 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1678 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:02.821611 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-e9d2fa48-968a-4c52-967e-7ad3417d9f8e tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:02.836201 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-e9d2fa48-968a-4c52-967e-7ad3417d9f8e tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1254 microversion: 2.1 time: 0.159434 Sep 01 14:10:02.836856 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 261/502] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:02 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1254 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:03.319448 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-2441d490-da3f-455d-8840-1184dce5f54c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "69297810-f373-4ebd-8c92-aca5c1c0ef59"}} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:10:03.322370 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-2441d490-da3f-455d-8840-1184dce5f54c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:03.335192 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2441d490-da3f-455d-8840-1184dce5f54c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:03.336030 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2441d490-da3f-455d-8840-1184dce5f54c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:03.336965 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2441d490-da3f-455d-8840-1184dce5f54c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:03.338190 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2441d490-da3f-455d-8840-1184dce5f54c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:03.338965 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2441d490-da3f-455d-8840-1184dce5f54c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:03.339575 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2441d490-da3f-455d-8840-1184dce5f54c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:03.696355 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-b07284b2-dafc-44c4-b35f-496aded7a6af tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:03.697093 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-b07284b2-dafc-44c4-b35f-496aded7a6af tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:03.704145 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b07284b2-dafc-44c4-b35f-496aded7a6af tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:03.704677 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b07284b2-dafc-44c4-b35f-496aded7a6af tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:03.705121 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b07284b2-dafc-44c4-b35f-496aded7a6af tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:03.705886 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b07284b2-dafc-44c4-b35f-496aded7a6af tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:03.706376 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b07284b2-dafc-44c4-b35f-496aded7a6af tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:03.706804 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b07284b2-dafc-44c4-b35f-496aded7a6af tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:03.863577 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-b07284b2-dafc-44c4-b35f-496aded7a6af tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:03.872129 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-b07284b2-dafc-44c4-b35f-496aded7a6af tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1443 microversion: 2.1 time: 0.179722 Sep 01 14:10:03.872912 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 262/503] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:03 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1443 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:10:03.878737 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-bf5da186-7d68-4e4e-9898-f4654e280b9f tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:03.879481 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-bf5da186-7d68-4e4e-9898-f4654e280b9f tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:03.886713 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bf5da186-7d68-4e4e-9898-f4654e280b9f tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:03.889457 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bf5da186-7d68-4e4e-9898-f4654e280b9f tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:03.889457 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bf5da186-7d68-4e4e-9898-f4654e280b9f tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:03.889457 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bf5da186-7d68-4e4e-9898-f4654e280b9f tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:03.889457 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bf5da186-7d68-4e4e-9898-f4654e280b9f tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:03.890020 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bf5da186-7d68-4e4e-9898-f4654e280b9f tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:04.066635 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-bf5da186-7d68-4e4e-9898-f4654e280b9f tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:04.076869 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-bf5da186-7d68-4e4e-9898-f4654e280b9f tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1678 microversion: 2.1 time: 0.202879 Sep 01 14:10:04.077858 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 263/504] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:03 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1678 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:04.098615 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-8033100e-7a70-4e55-82af-6cdfec1527b0 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:04.099242 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-8033100e-7a70-4e55-82af-6cdfec1527b0 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:04.107098 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8033100e-7a70-4e55-82af-6cdfec1527b0 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:04.107619 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8033100e-7a70-4e55-82af-6cdfec1527b0 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:04.108103 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8033100e-7a70-4e55-82af-6cdfec1527b0 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:04.108815 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8033100e-7a70-4e55-82af-6cdfec1527b0 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:04.109292 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8033100e-7a70-4e55-82af-6cdfec1527b0 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:04.109711 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8033100e-7a70-4e55-82af-6cdfec1527b0 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:04.180897 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-8033100e-7a70-4e55-82af-6cdfec1527b0 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:04.194146 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-8033100e-7a70-4e55-82af-6cdfec1527b0 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1310 microversion: 2.1 time: 0.100641 Sep 01 14:10:04.209941 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 264/505] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:04 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1310 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:04.209941 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-d9e430ff-6f5f-4d0a-a705-0ba7092606fe tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:04.209941 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-d9e430ff-6f5f-4d0a-a705-0ba7092606fe tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:04.218740 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d9e430ff-6f5f-4d0a-a705-0ba7092606fe tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:04.219537 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d9e430ff-6f5f-4d0a-a705-0ba7092606fe tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:04.220857 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d9e430ff-6f5f-4d0a-a705-0ba7092606fe tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:04.222601 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d9e430ff-6f5f-4d0a-a705-0ba7092606fe tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:04.223776 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d9e430ff-6f5f-4d0a-a705-0ba7092606fe tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:04.224863 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d9e430ff-6f5f-4d0a-a705-0ba7092606fe tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:04.447751 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-d9e430ff-6f5f-4d0a-a705-0ba7092606fe tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:04.459833 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-d9e430ff-6f5f-4d0a-a705-0ba7092606fe tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1443 microversion: 2.1 time: 0.263056 Sep 01 14:10:04.460438 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 265/506] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:04 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1443 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:04.807311 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-2441d490-da3f-455d-8840-1184dce5f54c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "POST /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.493086 Sep 01 14:10:04.808106 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 242/507] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Sep 1 14:10:03 2022] POST /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5/os-volume_attachments => generated 194 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:10:05.107230 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-ce1c3b9b-3a8d-4e04-8216-32c2e8683ff1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:05.108282 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-ce1c3b9b-3a8d-4e04-8216-32c2e8683ff1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:05.128119 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ce1c3b9b-3a8d-4e04-8216-32c2e8683ff1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:05.128872 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ce1c3b9b-3a8d-4e04-8216-32c2e8683ff1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:05.129539 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ce1c3b9b-3a8d-4e04-8216-32c2e8683ff1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:05.130518 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ce1c3b9b-3a8d-4e04-8216-32c2e8683ff1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:05.131161 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ce1c3b9b-3a8d-4e04-8216-32c2e8683ff1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:05.131735 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ce1c3b9b-3a8d-4e04-8216-32c2e8683ff1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:05.240035 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-08af0670-db59-4c89-86bf-b875811ed1b2 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:05.240759 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-08af0670-db59-4c89-86bf-b875811ed1b2 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:05.251963 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-08af0670-db59-4c89-86bf-b875811ed1b2 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:05.252461 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-08af0670-db59-4c89-86bf-b875811ed1b2 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:05.253121 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-08af0670-db59-4c89-86bf-b875811ed1b2 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:05.253870 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-08af0670-db59-4c89-86bf-b875811ed1b2 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:05.254371 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-08af0670-db59-4c89-86bf-b875811ed1b2 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:05.255063 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-08af0670-db59-4c89-86bf-b875811ed1b2 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:05.374517 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-08af0670-db59-4c89-86bf-b875811ed1b2 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:05.386051 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-08af0670-db59-4c89-86bf-b875811ed1b2 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1316 microversion: 2.1 time: 0.152629 Sep 01 14:10:05.387208 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 243/508] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:05 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:05.457890 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-ce1c3b9b-3a8d-4e04-8216-32c2e8683ff1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:05.467933 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-ce1c3b9b-3a8d-4e04-8216-32c2e8683ff1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1678 microversion: 2.1 time: 0.365656 Sep 01 14:10:05.468749 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 266/509] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:05 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1678 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:06.414421 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-fd6c07b5-99ee-4c89-962d-2c52bc966553 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:06.415559 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-fd6c07b5-99ee-4c89-962d-2c52bc966553 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:06.428413 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fd6c07b5-99ee-4c89-962d-2c52bc966553 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:06.429273 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fd6c07b5-99ee-4c89-962d-2c52bc966553 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:06.458955 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fd6c07b5-99ee-4c89-962d-2c52bc966553 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:06.458955 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fd6c07b5-99ee-4c89-962d-2c52bc966553 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:06.458955 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fd6c07b5-99ee-4c89-962d-2c52bc966553 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:06.458955 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fd6c07b5-99ee-4c89-962d-2c52bc966553 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:06.500127 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-a683e3c7-6465-4f52-a930-810d217e4188 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:06.501273 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-a683e3c7-6465-4f52-a930-810d217e4188 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:06.505985 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell0:SELECT=2 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:10:06.507239 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:10:06.515897 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a683e3c7-6465-4f52-a930-810d217e4188 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:06.516797 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a683e3c7-6465-4f52-a930-810d217e4188 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:06.517729 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a683e3c7-6465-4f52-a930-810d217e4188 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:06.518452 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell0:SELECT=6 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:10:06.519255 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a683e3c7-6465-4f52-a930-810d217e4188 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:06.520026 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a683e3c7-6465-4f52-a930-810d217e4188 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:06.520822 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a683e3c7-6465-4f52-a930-810d217e4188 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:06.751919 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-fd6c07b5-99ee-4c89-962d-2c52bc966553 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:06.762168 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-fd6c07b5-99ee-4c89-962d-2c52bc966553 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1358 microversion: 2.1 time: 0.356454 Sep 01 14:10:06.773953 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 244/510] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:06 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1358 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:06.825724 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-a683e3c7-6465-4f52-a930-810d217e4188 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:06.849415 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-a683e3c7-6465-4f52-a930-810d217e4188 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1678 microversion: 2.1 time: 0.356774 Sep 01 14:10:06.850037 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 267/511] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:06 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1678 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:07.735592 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [req-78410661-8535-4977-8a58-6bb8f5957305 req-34f96b5e-ca72-40af-86c1-6b55d6d8a478 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cc866f4-91c1-4384-b88a-5866ca150aea", "tag": "9b44c940-faa5-4df3-83f2-2d676ad70287"}]} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:10:07.747645 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-78410661-8535-4977-8a58-6bb8f5957305 req-34f96b5e-ca72-40af-86c1-6b55d6d8a478 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:07.748396 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-78410661-8535-4977-8a58-6bb8f5957305 req-34f96b5e-ca72-40af-86c1-6b55d6d8a478 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:07.749088 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-78410661-8535-4977-8a58-6bb8f5957305 req-34f96b5e-ca72-40af-86c1-6b55d6d8a478 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:07.764058 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.compute.server_external_events [req-78410661-8535-4977-8a58-6bb8f5957305 req-34f96b5e-ca72-40af-86c1-6b55d6d8a478 service nova] Creating event network-changed:9b44c940-faa5-4df3-83f2-2d676ad70287 for instance 3cc866f4-91c1-4384-b88a-5866ca150aea on hv-cinder-85221 Sep 01 14:10:07.770154 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [req-78410661-8535-4977-8a58-6bb8f5957305 req-34f96b5e-ca72-40af-86c1-6b55d6d8a478 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041487 Sep 01 14:10:07.770910 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 245/512] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:10:07.791576 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-6cb48571-0ef4-43e0-ae67-22eded8013b1 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:07.792768 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-6cb48571-0ef4-43e0-ae67-22eded8013b1 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:07.797403 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell0:SELECT=8 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:10:07.808205 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6cb48571-0ef4-43e0-ae67-22eded8013b1 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:07.809059 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6cb48571-0ef4-43e0-ae67-22eded8013b1 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:07.809846 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6cb48571-0ef4-43e0-ae67-22eded8013b1 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:07.811272 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6cb48571-0ef4-43e0-ae67-22eded8013b1 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:07.812156 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6cb48571-0ef4-43e0-ae67-22eded8013b1 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:07.812801 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6cb48571-0ef4-43e0-ae67-22eded8013b1 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:07.885497 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-350dbf1d-7f3b-480e-8249-9fb2e4930bfa tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:07.886686 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-350dbf1d-7f3b-480e-8249-9fb2e4930bfa tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:07.894606 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-350dbf1d-7f3b-480e-8249-9fb2e4930bfa tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:07.895104 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-350dbf1d-7f3b-480e-8249-9fb2e4930bfa tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:07.895752 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-350dbf1d-7f3b-480e-8249-9fb2e4930bfa tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:07.897195 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-350dbf1d-7f3b-480e-8249-9fb2e4930bfa tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:07.897195 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-350dbf1d-7f3b-480e-8249-9fb2e4930bfa tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:07.897685 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-350dbf1d-7f3b-480e-8249-9fb2e4930bfa tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:08.387780 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-6cb48571-0ef4-43e0-ae67-22eded8013b1 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:08.398088 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-350dbf1d-7f3b-480e-8249-9fb2e4930bfa tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:08.409473 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-350dbf1d-7f3b-480e-8249-9fb2e4930bfa tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1678 microversion: 2.1 time: 0.528946 Sep 01 14:10:08.410976 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 246/513] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:07 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1678 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:08.414429 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-6cb48571-0ef4-43e0-ae67-22eded8013b1 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1358 microversion: 2.1 time: 0.629486 Sep 01 14:10:08.415632 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 268/514] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:07 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1358 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:10:09.437124 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-8e127a4c-d394-402a-9c1f-07bcf1a5f8d4 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:09.437727 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-8e127a4c-d394-402a-9c1f-07bcf1a5f8d4 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:09.446222 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8e127a4c-d394-402a-9c1f-07bcf1a5f8d4 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:09.446713 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8e127a4c-d394-402a-9c1f-07bcf1a5f8d4 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:09.447149 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8e127a4c-d394-402a-9c1f-07bcf1a5f8d4 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:09.447561 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-5cb25fb0-0aa5-47ba-95f2-aed12d23e563 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:09.448396 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8e127a4c-d394-402a-9c1f-07bcf1a5f8d4 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:09.448396 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8e127a4c-d394-402a-9c1f-07bcf1a5f8d4 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:09.448711 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-5cb25fb0-0aa5-47ba-95f2-aed12d23e563 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:09.448898 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8e127a4c-d394-402a-9c1f-07bcf1a5f8d4 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:09.458289 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5cb25fb0-0aa5-47ba-95f2-aed12d23e563 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:09.458961 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5cb25fb0-0aa5-47ba-95f2-aed12d23e563 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:09.459588 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5cb25fb0-0aa5-47ba-95f2-aed12d23e563 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:09.460488 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5cb25fb0-0aa5-47ba-95f2-aed12d23e563 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:09.461013 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5cb25fb0-0aa5-47ba-95f2-aed12d23e563 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:09.461447 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5cb25fb0-0aa5-47ba-95f2-aed12d23e563 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:09.682002 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-8e127a4c-d394-402a-9c1f-07bcf1a5f8d4 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:09.694135 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-8e127a4c-d394-402a-9c1f-07bcf1a5f8d4 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1358 microversion: 2.1 time: 0.260371 Sep 01 14:10:09.694891 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 247/515] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:09 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1358 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:09.698261 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-5cb25fb0-0aa5-47ba-95f2-aed12d23e563 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:09.713563 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-5cb25fb0-0aa5-47ba-95f2-aed12d23e563 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1678 microversion: 2.1 time: 0.270388 Sep 01 14:10:09.714699 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 269/516] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:09 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1678 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:10:10.362658 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [req-1ad45917-882f-4b8e-b785-f14a4ae77db8 req-f2c4efae-4371-416a-8606-0147099fb9ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d917f141-65db-49b0-87ed-0e1e0b72bb4a", "tag": "9784e98b-3dcc-42d6-a82e-41f46d73700f"}]} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:10:10.393350 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-1ad45917-882f-4b8e-b785-f14a4ae77db8 req-f2c4efae-4371-416a-8606-0147099fb9ed service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:10.396117 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-1ad45917-882f-4b8e-b785-f14a4ae77db8 req-f2c4efae-4371-416a-8606-0147099fb9ed service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:10.397323 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-1ad45917-882f-4b8e-b785-f14a4ae77db8 req-f2c4efae-4371-416a-8606-0147099fb9ed service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:10.431686 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.compute.server_external_events [req-1ad45917-882f-4b8e-b785-f14a4ae77db8 req-f2c4efae-4371-416a-8606-0147099fb9ed service nova] Creating event network-changed:9784e98b-3dcc-42d6-a82e-41f46d73700f for instance d917f141-65db-49b0-87ed-0e1e0b72bb4a on hv-cinder-85221 Sep 01 14:10:10.441440 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [req-1ad45917-882f-4b8e-b785-f14a4ae77db8 req-f2c4efae-4371-416a-8606-0147099fb9ed service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087986 Sep 01 14:10:10.442899 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 248/517] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:10:10.723059 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-48591325-557d-4d97-9e59-51b4a2de2403 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:10.725099 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-48591325-557d-4d97-9e59-51b4a2de2403 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:10.739994 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-48591325-557d-4d97-9e59-51b4a2de2403 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:10.740879 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-48591325-557d-4d97-9e59-51b4a2de2403 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:10.741987 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-48591325-557d-4d97-9e59-51b4a2de2403 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:10.742178 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-0ca823b3-795f-41e5-a60d-56170ff5b7b4 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:10.743356 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-0ca823b3-795f-41e5-a60d-56170ff5b7b4 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:10.744024 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-48591325-557d-4d97-9e59-51b4a2de2403 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:10.745103 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-48591325-557d-4d97-9e59-51b4a2de2403 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:10.746100 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-48591325-557d-4d97-9e59-51b4a2de2403 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:10.754351 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0ca823b3-795f-41e5-a60d-56170ff5b7b4 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:10.755719 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0ca823b3-795f-41e5-a60d-56170ff5b7b4 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:10.756440 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0ca823b3-795f-41e5-a60d-56170ff5b7b4 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:10.757673 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0ca823b3-795f-41e5-a60d-56170ff5b7b4 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:10.758505 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0ca823b3-795f-41e5-a60d-56170ff5b7b4 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:10.759224 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0ca823b3-795f-41e5-a60d-56170ff5b7b4 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:11.017313 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-48591325-557d-4d97-9e59-51b4a2de2403 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:11.017557 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-0ca823b3-795f-41e5-a60d-56170ff5b7b4 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:11.024441 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-0ca823b3-795f-41e5-a60d-56170ff5b7b4 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1678 microversion: 2.1 time: 0.289049 Sep 01 14:10:11.025161 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 249/518] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:10 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1678 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:10:11.042837 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-48591325-557d-4d97-9e59-51b4a2de2403 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1358 microversion: 2.1 time: 0.328294 Sep 01 14:10:11.049962 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 270/519] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:10 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1358 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:10:12.053785 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-aea3f53a-cedb-42fa-bc1c-e9c9f8148c28 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:12.056115 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-aea3f53a-cedb-42fa-bc1c-e9c9f8148c28 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:12.067813 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-aea3f53a-cedb-42fa-bc1c-e9c9f8148c28 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:12.068859 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-aea3f53a-cedb-42fa-bc1c-e9c9f8148c28 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:12.070209 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-aea3f53a-cedb-42fa-bc1c-e9c9f8148c28 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:12.071544 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-aea3f53a-cedb-42fa-bc1c-e9c9f8148c28 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:12.072632 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-aea3f53a-cedb-42fa-bc1c-e9c9f8148c28 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:12.073659 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-aea3f53a-cedb-42fa-bc1c-e9c9f8148c28 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:12.086351 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-674b2544-daf3-4036-b10c-3b69a6c0d4b9 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:12.087386 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-674b2544-daf3-4036-b10c-3b69a6c0d4b9 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:12.104578 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-674b2544-daf3-4036-b10c-3b69a6c0d4b9 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:12.105474 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-674b2544-daf3-4036-b10c-3b69a6c0d4b9 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:12.118990 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-674b2544-daf3-4036-b10c-3b69a6c0d4b9 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:12.120215 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-674b2544-daf3-4036-b10c-3b69a6c0d4b9 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:12.121003 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-674b2544-daf3-4036-b10c-3b69a6c0d4b9 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:12.121724 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-674b2544-daf3-4036-b10c-3b69a6c0d4b9 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:12.423708 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-aea3f53a-cedb-42fa-bc1c-e9c9f8148c28 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:12.435129 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-674b2544-daf3-4036-b10c-3b69a6c0d4b9 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:12.435438 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-aea3f53a-cedb-42fa-bc1c-e9c9f8148c28 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1678 microversion: 2.1 time: 0.389897 Sep 01 14:10:12.445664 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 250/520] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:12 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1678 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:12.458613 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-674b2544-daf3-4036-b10c-3b69a6c0d4b9 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1358 microversion: 2.1 time: 0.380033 Sep 01 14:10:12.474282 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 271/521] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:12 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1358 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:13.460694 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-5687de46-a3ce-464b-b040-c5dab76bc0f0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:13.461339 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-5687de46-a3ce-464b-b040-c5dab76bc0f0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:13.468383 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5687de46-a3ce-464b-b040-c5dab76bc0f0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:13.468869 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5687de46-a3ce-464b-b040-c5dab76bc0f0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:13.469304 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5687de46-a3ce-464b-b040-c5dab76bc0f0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:13.470189 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5687de46-a3ce-464b-b040-c5dab76bc0f0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:13.470905 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5687de46-a3ce-464b-b040-c5dab76bc0f0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:13.471342 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5687de46-a3ce-464b-b040-c5dab76bc0f0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:13.501097 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-78e31004-a1fb-4b35-9e3c-cf0de5c553b6 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:13.503223 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-78e31004-a1fb-4b35-9e3c-cf0de5c553b6 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:13.510302 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-78e31004-a1fb-4b35-9e3c-cf0de5c553b6 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:13.510786 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-78e31004-a1fb-4b35-9e3c-cf0de5c553b6 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:13.511219 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-78e31004-a1fb-4b35-9e3c-cf0de5c553b6 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:13.511929 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-78e31004-a1fb-4b35-9e3c-cf0de5c553b6 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:13.512376 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-78e31004-a1fb-4b35-9e3c-cf0de5c553b6 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:13.530044 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-78e31004-a1fb-4b35-9e3c-cf0de5c553b6 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:13.696706 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-5687de46-a3ce-464b-b040-c5dab76bc0f0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:13.708902 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-5687de46-a3ce-464b-b040-c5dab76bc0f0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1678 microversion: 2.1 time: 0.253173 Sep 01 14:10:13.710182 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 251/522] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:13 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1678 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:13.776580 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-78e31004-a1fb-4b35-9e3c-cf0de5c553b6 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:13.788219 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-78e31004-a1fb-4b35-9e3c-cf0de5c553b6 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1358 microversion: 2.1 time: 0.291757 Sep 01 14:10:13.788852 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 272/523] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:13 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1358 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:13.891276 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-2f9992e0-ec40-47cf-b639-381ebfc44802 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:13.891947 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-2f9992e0-ec40-47cf-b639-381ebfc44802 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 81fe7593-66bc-442e-bd42-67dbb727a356] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:13.899074 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2f9992e0-ec40-47cf-b639-381ebfc44802 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:13.899563 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2f9992e0-ec40-47cf-b639-381ebfc44802 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:13.899994 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2f9992e0-ec40-47cf-b639-381ebfc44802 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:13.900696 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2f9992e0-ec40-47cf-b639-381ebfc44802 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:13.901143 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2f9992e0-ec40-47cf-b639-381ebfc44802 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:13.901568 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2f9992e0-ec40-47cf-b639-381ebfc44802 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:14.053329 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:10:14.064290 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.objects.instance [None req-2f9992e0-ec40-47cf-b639-381ebfc44802 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lazy-loading 'services' on Instance uuid 81fe7593-66bc-442e-bd42-67dbb727a356 {{(pid=121339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:10:14.649335 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-2f9992e0-ec40-47cf-b639-381ebfc44802 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "DELETE /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356/os-volume_attachments/bd44f175-c610-42a0-a6ea-1cfa6fe46ed6" status: 202 len: 0 microversion: 2.1 time: 0.761739 Sep 01 14:10:14.650269 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 252/524] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Sep 1 14:10:13 2022] DELETE /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356/os-volume_attachments/bd44f175-c610-42a0-a6ea-1cfa6fe46ed6 => generated 0 bytes in 764 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:10:14.745402 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-006f9e2d-a613-486f-a5f4-34bcc43ff928 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:14.746589 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-006f9e2d-a613-486f-a5f4-34bcc43ff928 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:14.759461 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-006f9e2d-a613-486f-a5f4-34bcc43ff928 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:14.760438 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-006f9e2d-a613-486f-a5f4-34bcc43ff928 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:14.761226 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-006f9e2d-a613-486f-a5f4-34bcc43ff928 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:14.762754 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-006f9e2d-a613-486f-a5f4-34bcc43ff928 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:14.763440 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-006f9e2d-a613-486f-a5f4-34bcc43ff928 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:14.763932 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-006f9e2d-a613-486f-a5f4-34bcc43ff928 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:14.817245 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-d8ed9f5c-62c1-4574-af93-51bd0613e61e tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:14.819024 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-d8ed9f5c-62c1-4574-af93-51bd0613e61e tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:14.846710 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d8ed9f5c-62c1-4574-af93-51bd0613e61e tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:14.847551 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d8ed9f5c-62c1-4574-af93-51bd0613e61e tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:14.848313 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d8ed9f5c-62c1-4574-af93-51bd0613e61e tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:14.849584 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d8ed9f5c-62c1-4574-af93-51bd0613e61e tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:14.850459 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d8ed9f5c-62c1-4574-af93-51bd0613e61e tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:14.851220 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d8ed9f5c-62c1-4574-af93-51bd0613e61e tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:15.048636 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-006f9e2d-a613-486f-a5f4-34bcc43ff928 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:15.058121 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-006f9e2d-a613-486f-a5f4-34bcc43ff928 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1678 microversion: 2.1 time: 0.325628 Sep 01 14:10:15.073608 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 273/525] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:14 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1678 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:15.120688 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-d8ed9f5c-62c1-4574-af93-51bd0613e61e tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:15.132461 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-d8ed9f5c-62c1-4574-af93-51bd0613e61e tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1358 microversion: 2.1 time: 0.325325 Sep 01 14:10:15.133031 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 253/526] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:14 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1358 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:10:16.085705 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-9af8895c-ce29-4e8e-a98f-83b2540e866a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:16.086769 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-9af8895c-ce29-4e8e-a98f-83b2540e866a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:16.096400 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9af8895c-ce29-4e8e-a98f-83b2540e866a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:16.097038 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9af8895c-ce29-4e8e-a98f-83b2540e866a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:16.097584 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9af8895c-ce29-4e8e-a98f-83b2540e866a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:16.098544 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9af8895c-ce29-4e8e-a98f-83b2540e866a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:16.099110 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9af8895c-ce29-4e8e-a98f-83b2540e866a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:16.099635 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9af8895c-ce29-4e8e-a98f-83b2540e866a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:16.103008 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell1:SELECT=100 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:10:16.161253 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-b91f9691-e5a0-4e7f-85ad-3ad617b5fe7c tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:16.162585 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-b91f9691-e5a0-4e7f-85ad-3ad617b5fe7c tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:16.179908 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b91f9691-e5a0-4e7f-85ad-3ad617b5fe7c tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:16.181235 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b91f9691-e5a0-4e7f-85ad-3ad617b5fe7c tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:16.182306 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b91f9691-e5a0-4e7f-85ad-3ad617b5fe7c tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:16.183944 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b91f9691-e5a0-4e7f-85ad-3ad617b5fe7c tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:16.185070 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b91f9691-e5a0-4e7f-85ad-3ad617b5fe7c tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:16.186143 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b91f9691-e5a0-4e7f-85ad-3ad617b5fe7c tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:16.425985 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-9af8895c-ce29-4e8e-a98f-83b2540e866a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:16.442749 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-9af8895c-ce29-4e8e-a98f-83b2540e866a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1678 microversion: 2.1 time: 0.364838 Sep 01 14:10:16.443882 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 274/527] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:16 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1678 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:16.465400 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-b91f9691-e5a0-4e7f-85ad-3ad617b5fe7c tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:16.481585 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-b91f9691-e5a0-4e7f-85ad-3ad617b5fe7c tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1358 microversion: 2.1 time: 0.329037 Sep 01 14:10:16.482720 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 254/528] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:16 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1358 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:17.479886 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-719c27de-5df2-4432-838f-161ff7dcec50 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:17.481082 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-719c27de-5df2-4432-838f-161ff7dcec50 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:17.494026 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-719c27de-5df2-4432-838f-161ff7dcec50 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:17.494720 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-719c27de-5df2-4432-838f-161ff7dcec50 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:17.495469 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-719c27de-5df2-4432-838f-161ff7dcec50 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:17.496766 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-719c27de-5df2-4432-838f-161ff7dcec50 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:17.497601 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-719c27de-5df2-4432-838f-161ff7dcec50 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:17.498410 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-719c27de-5df2-4432-838f-161ff7dcec50 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:17.520716 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-15c8b0a0-8976-4e45-9c16-13c8d2edd27d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:17.521736 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-15c8b0a0-8976-4e45-9c16-13c8d2edd27d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:17.538528 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-15c8b0a0-8976-4e45-9c16-13c8d2edd27d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:17.540144 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-15c8b0a0-8976-4e45-9c16-13c8d2edd27d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:17.541316 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-15c8b0a0-8976-4e45-9c16-13c8d2edd27d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:17.543184 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-15c8b0a0-8976-4e45-9c16-13c8d2edd27d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:17.544059 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-15c8b0a0-8976-4e45-9c16-13c8d2edd27d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:17.544840 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-15c8b0a0-8976-4e45-9c16-13c8d2edd27d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:17.847255 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-719c27de-5df2-4432-838f-161ff7dcec50 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:17.859023 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-15c8b0a0-8976-4e45-9c16-13c8d2edd27d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:17.867029 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-719c27de-5df2-4432-838f-161ff7dcec50 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1678 microversion: 2.1 time: 0.394191 Sep 01 14:10:17.868037 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 275/529] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:17 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1678 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:17.885447 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-15c8b0a0-8976-4e45-9c16-13c8d2edd27d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1358 microversion: 2.1 time: 0.372201 Sep 01 14:10:17.893281 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 255/530] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:17 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1358 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:18.895087 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-f8d2860e-4b9b-4c7a-8b50-29c249de281b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:18.896215 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-f8d2860e-4b9b-4c7a-8b50-29c249de281b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:18.909187 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f8d2860e-4b9b-4c7a-8b50-29c249de281b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:18.912774 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f8d2860e-4b9b-4c7a-8b50-29c249de281b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:18.913721 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f8d2860e-4b9b-4c7a-8b50-29c249de281b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:18.915328 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f8d2860e-4b9b-4c7a-8b50-29c249de281b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:18.916431 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f8d2860e-4b9b-4c7a-8b50-29c249de281b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:18.917334 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f8d2860e-4b9b-4c7a-8b50-29c249de281b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:18.922987 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-5d5e329e-21fd-45c7-a244-d9361f088d14 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:18.924629 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-5d5e329e-21fd-45c7-a244-d9361f088d14 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:18.927399 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=1 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:10:18.933663 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5d5e329e-21fd-45c7-a244-d9361f088d14 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:18.942682 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5d5e329e-21fd-45c7-a244-d9361f088d14 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:18.942682 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5d5e329e-21fd-45c7-a244-d9361f088d14 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:18.942682 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5d5e329e-21fd-45c7-a244-d9361f088d14 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:18.942682 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5d5e329e-21fd-45c7-a244-d9361f088d14 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:18.943066 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5d5e329e-21fd-45c7-a244-d9361f088d14 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:19.159039 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-5d5e329e-21fd-45c7-a244-d9361f088d14 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:19.167959 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-5d5e329e-21fd-45c7-a244-d9361f088d14 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1358 microversion: 2.1 time: 0.252650 Sep 01 14:10:19.192040 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 256/531] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:18 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1358 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:19.192649 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-f8d2860e-4b9b-4c7a-8b50-29c249de281b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:19.192649 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-f8d2860e-4b9b-4c7a-8b50-29c249de281b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1678 microversion: 2.1 time: 0.305542 Sep 01 14:10:19.198319 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 276/532] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:18 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1678 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:20.205254 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-94f8bada-97c9-4dc0-a283-75dcfea91a75 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:20.206875 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-94f8bada-97c9-4dc0-a283-75dcfea91a75 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:20.223635 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-94f8bada-97c9-4dc0-a283-75dcfea91a75 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:20.224510 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-94f8bada-97c9-4dc0-a283-75dcfea91a75 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:20.224678 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-26d064e6-d6c4-4b44-a276-060f89c2c687 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:20.225254 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-94f8bada-97c9-4dc0-a283-75dcfea91a75 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:20.226178 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-26d064e6-d6c4-4b44-a276-060f89c2c687 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:20.232766 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-94f8bada-97c9-4dc0-a283-75dcfea91a75 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:20.234119 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-94f8bada-97c9-4dc0-a283-75dcfea91a75 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:20.235151 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-94f8bada-97c9-4dc0-a283-75dcfea91a75 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:20.249533 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-26d064e6-d6c4-4b44-a276-060f89c2c687 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:20.258200 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-26d064e6-d6c4-4b44-a276-060f89c2c687 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:20.258830 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-26d064e6-d6c4-4b44-a276-060f89c2c687 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:20.268364 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-26d064e6-d6c4-4b44-a276-060f89c2c687 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:20.269040 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-26d064e6-d6c4-4b44-a276-060f89c2c687 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:20.269822 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-26d064e6-d6c4-4b44-a276-060f89c2c687 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:20.627989 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-94f8bada-97c9-4dc0-a283-75dcfea91a75 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:20.638032 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-26d064e6-d6c4-4b44-a276-060f89c2c687 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:20.643869 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-94f8bada-97c9-4dc0-a283-75dcfea91a75 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1358 microversion: 2.1 time: 0.447158 Sep 01 14:10:20.646315 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 257/533] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:20 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1358 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:10:20.653747 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-26d064e6-d6c4-4b44-a276-060f89c2c687 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1678 microversion: 2.1 time: 0.441852 Sep 01 14:10:20.655385 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 277/534] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:20 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1678 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:21.668762 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-e74a7346-84ec-43cc-80e2-e557026ad088 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:21.669459 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-e74a7346-84ec-43cc-80e2-e557026ad088 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:21.677128 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e74a7346-84ec-43cc-80e2-e557026ad088 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:21.677628 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e74a7346-84ec-43cc-80e2-e557026ad088 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:21.678116 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e74a7346-84ec-43cc-80e2-e557026ad088 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:21.678840 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e74a7346-84ec-43cc-80e2-e557026ad088 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:21.679295 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e74a7346-84ec-43cc-80e2-e557026ad088 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:21.679721 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e74a7346-84ec-43cc-80e2-e557026ad088 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:21.690791 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-4cfe0b39-f6d4-4616-aae3-ff11fae49c77 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:21.691880 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-4cfe0b39-f6d4-4616-aae3-ff11fae49c77 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:21.703227 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4cfe0b39-f6d4-4616-aae3-ff11fae49c77 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:21.718646 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4cfe0b39-f6d4-4616-aae3-ff11fae49c77 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:21.718646 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4cfe0b39-f6d4-4616-aae3-ff11fae49c77 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:21.718646 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4cfe0b39-f6d4-4616-aae3-ff11fae49c77 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:21.718646 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4cfe0b39-f6d4-4616-aae3-ff11fae49c77 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:21.719302 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4cfe0b39-f6d4-4616-aae3-ff11fae49c77 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:21.904589 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-e74a7346-84ec-43cc-80e2-e557026ad088 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:21.918995 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-e74a7346-84ec-43cc-80e2-e557026ad088 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1358 microversion: 2.1 time: 0.254293 Sep 01 14:10:21.934010 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 258/535] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:21 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1358 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:21.960696 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-4cfe0b39-f6d4-4616-aae3-ff11fae49c77 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:21.976251 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-4cfe0b39-f6d4-4616-aae3-ff11fae49c77 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1678 microversion: 2.1 time: 0.290971 Sep 01 14:10:21.977280 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 278/536] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:21 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1678 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:10:22.974331 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-6bb98512-7857-47f8-9947-eec17340d04c tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:22.975131 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-6bb98512-7857-47f8-9947-eec17340d04c tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:22.982689 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6bb98512-7857-47f8-9947-eec17340d04c tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:22.983074 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6bb98512-7857-47f8-9947-eec17340d04c tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:22.983583 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6bb98512-7857-47f8-9947-eec17340d04c tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:22.984326 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6bb98512-7857-47f8-9947-eec17340d04c tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:22.984796 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6bb98512-7857-47f8-9947-eec17340d04c tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:22.985259 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6bb98512-7857-47f8-9947-eec17340d04c tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:23.004082 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-01474465-0bef-4a99-b76e-204d38fdada4 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:23.005409 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-01474465-0bef-4a99-b76e-204d38fdada4 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:23.015556 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-01474465-0bef-4a99-b76e-204d38fdada4 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:23.016365 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-01474465-0bef-4a99-b76e-204d38fdada4 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:23.019385 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-01474465-0bef-4a99-b76e-204d38fdada4 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:23.021289 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-01474465-0bef-4a99-b76e-204d38fdada4 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:23.022200 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-01474465-0bef-4a99-b76e-204d38fdada4 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:23.022942 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-01474465-0bef-4a99-b76e-204d38fdada4 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:23.239993 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-6bb98512-7857-47f8-9947-eec17340d04c tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:23.252420 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-6bb98512-7857-47f8-9947-eec17340d04c tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1358 microversion: 2.1 time: 0.281041 Sep 01 14:10:23.253183 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 259/537] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:22 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1358 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:23.254947 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-01474465-0bef-4a99-b76e-204d38fdada4 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:23.270346 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-01474465-0bef-4a99-b76e-204d38fdada4 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1655 microversion: 2.1 time: 0.274712 Sep 01 14:10:23.271405 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 279/538] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:22 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1655 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:23.292849 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-1fc80cab-67f7-4ba9-8f0d-7ce03198ae1c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:10:23.299844 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1fc80cab-67f7-4ba9-8f0d-7ce03198ae1c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:23.300338 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1fc80cab-67f7-4ba9-8f0d-7ce03198ae1c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:23.300777 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1fc80cab-67f7-4ba9-8f0d-7ce03198ae1c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:23.327990 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-1fc80cab-67f7-4ba9-8f0d-7ce03198ae1c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Going to try to start instance {{(pid=121339) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 01 14:10:23.639838 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-1fc80cab-67f7-4ba9-8f0d-7ce03198ae1c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "POST /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7/action" status: 202 len: 0 microversion: 2.1 time: 0.350958 Sep 01 14:10:23.642671 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 260/539] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Sep 1 14:10:23 2022] POST /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:10:23.654418 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-98326ac0-29b2-4158-bc1f-322511afa2ae tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:23.655925 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-98326ac0-29b2-4158-bc1f-322511afa2ae tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:23.667965 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-98326ac0-29b2-4158-bc1f-322511afa2ae tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:23.668977 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-98326ac0-29b2-4158-bc1f-322511afa2ae tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:23.669826 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-98326ac0-29b2-4158-bc1f-322511afa2ae tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:23.679630 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-98326ac0-29b2-4158-bc1f-322511afa2ae tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:23.679630 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-98326ac0-29b2-4158-bc1f-322511afa2ae tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:23.679630 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-98326ac0-29b2-4158-bc1f-322511afa2ae tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:23.852087 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-98326ac0-29b2-4158-bc1f-322511afa2ae tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:23.860319 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-98326ac0-29b2-4158-bc1f-322511afa2ae tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1664 microversion: 2.1 time: 0.214135 Sep 01 14:10:23.860907 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 280/540] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:23 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1664 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:24.276338 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-571dce32-82d9-45f7-acae-a7630eed95af tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:24.277049 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-571dce32-82d9-45f7-acae-a7630eed95af tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:24.284270 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-571dce32-82d9-45f7-acae-a7630eed95af tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:24.284906 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-571dce32-82d9-45f7-acae-a7630eed95af tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:24.285495 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-571dce32-82d9-45f7-acae-a7630eed95af tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:24.286337 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-571dce32-82d9-45f7-acae-a7630eed95af tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:24.286890 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-571dce32-82d9-45f7-acae-a7630eed95af tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:24.287408 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-571dce32-82d9-45f7-acae-a7630eed95af tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:24.517938 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-571dce32-82d9-45f7-acae-a7630eed95af tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:24.551224 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-571dce32-82d9-45f7-acae-a7630eed95af tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1358 microversion: 2.1 time: 0.279483 Sep 01 14:10:24.552741 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 261/541] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:24 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1358 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:24.885821 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-6023158e-c095-4abb-914c-b1c03c1819d6 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:24.886692 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-6023158e-c095-4abb-914c-b1c03c1819d6 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:24.898700 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6023158e-c095-4abb-914c-b1c03c1819d6 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:24.899586 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6023158e-c095-4abb-914c-b1c03c1819d6 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:24.900379 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6023158e-c095-4abb-914c-b1c03c1819d6 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:24.901660 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6023158e-c095-4abb-914c-b1c03c1819d6 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:24.902550 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6023158e-c095-4abb-914c-b1c03c1819d6 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:24.903640 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6023158e-c095-4abb-914c-b1c03c1819d6 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:25.143525 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-6023158e-c095-4abb-914c-b1c03c1819d6 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:25.152757 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-6023158e-c095-4abb-914c-b1c03c1819d6 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1664 microversion: 2.1 time: 0.273253 Sep 01 14:10:25.153365 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 281/542] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:24 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1664 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:25.589091 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-95aae53d-22b4-4470-a07d-1db5d3fd930c tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:25.589793 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-95aae53d-22b4-4470-a07d-1db5d3fd930c tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:25.597582 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-95aae53d-22b4-4470-a07d-1db5d3fd930c tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:25.598132 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-95aae53d-22b4-4470-a07d-1db5d3fd930c tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:25.598838 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-95aae53d-22b4-4470-a07d-1db5d3fd930c tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:25.599574 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-95aae53d-22b4-4470-a07d-1db5d3fd930c tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:25.600097 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-95aae53d-22b4-4470-a07d-1db5d3fd930c tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:25.600542 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-95aae53d-22b4-4470-a07d-1db5d3fd930c tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:25.786046 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-95aae53d-22b4-4470-a07d-1db5d3fd930c tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:25.801233 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-95aae53d-22b4-4470-a07d-1db5d3fd930c tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1358 microversion: 2.1 time: 0.218834 Sep 01 14:10:25.801992 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 262/543] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:25 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1358 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:26.177796 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-0881b449-a101-40a9-8101-bd9d3ba7389a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:26.178509 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-0881b449-a101-40a9-8101-bd9d3ba7389a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:26.185363 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0881b449-a101-40a9-8101-bd9d3ba7389a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:26.185851 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0881b449-a101-40a9-8101-bd9d3ba7389a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:26.186328 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0881b449-a101-40a9-8101-bd9d3ba7389a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:26.187046 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0881b449-a101-40a9-8101-bd9d3ba7389a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:26.187502 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0881b449-a101-40a9-8101-bd9d3ba7389a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:26.187919 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0881b449-a101-40a9-8101-bd9d3ba7389a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:26.361929 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-0881b449-a101-40a9-8101-bd9d3ba7389a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:26.372562 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-0881b449-a101-40a9-8101-bd9d3ba7389a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1668 microversion: 2.1 time: 0.198714 Sep 01 14:10:26.373298 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 282/544] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:26 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1668 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:26.779826 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [req-e1d80358-91d8-4ef4-a1e1-a6f87bfa185a req-2f4680db-e2c1-4f64-a301-5d75f26fe254 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d917f141-65db-49b0-87ed-0e1e0b72bb4a", "name": "network-vif-plugged", "status": "completed", "tag": "9784e98b-3dcc-42d6-a82e-41f46d73700f"}]} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:10:26.791879 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-e1d80358-91d8-4ef4-a1e1-a6f87bfa185a req-2f4680db-e2c1-4f64-a301-5d75f26fe254 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:26.792366 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-e1d80358-91d8-4ef4-a1e1-a6f87bfa185a req-2f4680db-e2c1-4f64-a301-5d75f26fe254 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:26.792801 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-e1d80358-91d8-4ef4-a1e1-a6f87bfa185a req-2f4680db-e2c1-4f64-a301-5d75f26fe254 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:26.805941 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.compute.server_external_events [req-e1d80358-91d8-4ef4-a1e1-a6f87bfa185a req-2f4680db-e2c1-4f64-a301-5d75f26fe254 service nova] Creating event network-vif-plugged:9784e98b-3dcc-42d6-a82e-41f46d73700f for instance d917f141-65db-49b0-87ed-0e1e0b72bb4a on hv-cinder-85221 Sep 01 14:10:26.825152 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [req-e1d80358-91d8-4ef4-a1e1-a6f87bfa185a req-2f4680db-e2c1-4f64-a301-5d75f26fe254 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036019 Sep 01 14:10:26.825152 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 263/545] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:10:26.832740 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-65ac11c0-03bc-49d7-932d-7191ae6bd553 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:26.833955 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-65ac11c0-03bc-49d7-932d-7191ae6bd553 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:26.844685 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-65ac11c0-03bc-49d7-932d-7191ae6bd553 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:26.846269 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-65ac11c0-03bc-49d7-932d-7191ae6bd553 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:26.846800 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-65ac11c0-03bc-49d7-932d-7191ae6bd553 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:26.847308 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-65ac11c0-03bc-49d7-932d-7191ae6bd553 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:26.847788 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-65ac11c0-03bc-49d7-932d-7191ae6bd553 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:26.848217 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-65ac11c0-03bc-49d7-932d-7191ae6bd553 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:27.048090 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-65ac11c0-03bc-49d7-932d-7191ae6bd553 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:27.065035 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-65ac11c0-03bc-49d7-932d-7191ae6bd553 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1358 microversion: 2.1 time: 0.243602 Sep 01 14:10:27.066124 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 283/546] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:26 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1358 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:28.090457 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-39f2f513-5e64-4671-9ccd-1926a619cb06 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:28.091145 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-39f2f513-5e64-4671-9ccd-1926a619cb06 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:28.098147 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-39f2f513-5e64-4671-9ccd-1926a619cb06 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:28.098647 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-39f2f513-5e64-4671-9ccd-1926a619cb06 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:28.099092 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-39f2f513-5e64-4671-9ccd-1926a619cb06 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:28.099811 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-39f2f513-5e64-4671-9ccd-1926a619cb06 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:28.100273 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-39f2f513-5e64-4671-9ccd-1926a619cb06 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:28.100702 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-39f2f513-5e64-4671-9ccd-1926a619cb06 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:28.258987 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-39f2f513-5e64-4671-9ccd-1926a619cb06 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:28.268590 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-39f2f513-5e64-4671-9ccd-1926a619cb06 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1358 microversion: 2.1 time: 0.182674 Sep 01 14:10:28.269232 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 264/547] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:28 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:29.293968 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-785d299f-b872-492d-8adc-83ab53794954 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:29.295637 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-785d299f-b872-492d-8adc-83ab53794954 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:29.303875 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-785d299f-b872-492d-8adc-83ab53794954 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:29.304388 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-785d299f-b872-492d-8adc-83ab53794954 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:29.304819 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-785d299f-b872-492d-8adc-83ab53794954 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:29.305525 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-785d299f-b872-492d-8adc-83ab53794954 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:29.306013 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-785d299f-b872-492d-8adc-83ab53794954 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:29.306436 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-785d299f-b872-492d-8adc-83ab53794954 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:29.489117 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-785d299f-b872-492d-8adc-83ab53794954 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:29.497833 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-785d299f-b872-492d-8adc-83ab53794954 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1358 microversion: 2.1 time: 0.211177 Sep 01 14:10:29.498469 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 284/548] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:29 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:30.050486 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-b9d56347-d7f8-4035-ada9-a6e0bdc2be5d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:10:30.052797 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-b9d56347-d7f8-4035-ada9-a6e0bdc2be5d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:30.060569 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b9d56347-d7f8-4035-ada9-a6e0bdc2be5d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:30.061062 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b9d56347-d7f8-4035-ada9-a6e0bdc2be5d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:30.061503 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b9d56347-d7f8-4035-ada9-a6e0bdc2be5d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:30.062270 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b9d56347-d7f8-4035-ada9-a6e0bdc2be5d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:30.062732 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b9d56347-d7f8-4035-ada9-a6e0bdc2be5d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:30.063171 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b9d56347-d7f8-4035-ada9-a6e0bdc2be5d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:30.091571 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.objects.instance [None req-b9d56347-d7f8-4035-ada9-a6e0bdc2be5d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lazy-loading 'flavor' on Instance uuid 1988647a-695e-49b8-a5d3-dd6c93c10ae5 {{(pid=121339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:10:30.515692 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-b9d56347-d7f8-4035-ada9-a6e0bdc2be5d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "POST /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5/action" status: 200 len: 32 microversion: 2.1 time: 0.469208 Sep 01 14:10:30.518301 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 265/549] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Sep 1 14:10:30 2022] POST /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5/action => generated 32 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 14:10:30.534916 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-45b6f5a9-b000-4f87-b958-a9bb8eed1ae8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:30.535836 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-45b6f5a9-b000-4f87-b958-a9bb8eed1ae8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:30.547398 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-647c7878-3ebe-429b-8c8e-2762f4e256e9 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:30.548149 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-647c7878-3ebe-429b-8c8e-2762f4e256e9 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:30.556238 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-45b6f5a9-b000-4f87-b958-a9bb8eed1ae8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:30.556871 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-647c7878-3ebe-429b-8c8e-2762f4e256e9 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:30.557434 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-647c7878-3ebe-429b-8c8e-2762f4e256e9 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:30.557951 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-45b6f5a9-b000-4f87-b958-a9bb8eed1ae8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:30.558356 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-647c7878-3ebe-429b-8c8e-2762f4e256e9 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:30.558743 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-45b6f5a9-b000-4f87-b958-a9bb8eed1ae8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:30.559110 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-647c7878-3ebe-429b-8c8e-2762f4e256e9 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:30.559598 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-647c7878-3ebe-429b-8c8e-2762f4e256e9 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:30.559939 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-45b6f5a9-b000-4f87-b958-a9bb8eed1ae8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:30.560122 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-647c7878-3ebe-429b-8c8e-2762f4e256e9 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:30.562058 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-45b6f5a9-b000-4f87-b958-a9bb8eed1ae8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:30.563132 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-45b6f5a9-b000-4f87-b958-a9bb8eed1ae8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:30.584982 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:10:30.790300 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-647c7878-3ebe-429b-8c8e-2762f4e256e9 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:30.800089 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-647c7878-3ebe-429b-8c8e-2762f4e256e9 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1358 microversion: 2.1 time: 0.256765 Sep 01 14:10:30.800730 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 266/550] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:30 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1358 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:30.821776 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-45b6f5a9-b000-4f87-b958-a9bb8eed1ae8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:30.840600 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-45b6f5a9-b000-4f87-b958-a9bb8eed1ae8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1734 microversion: 2.1 time: 0.316406 Sep 01 14:10:30.841645 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 285/551] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:30 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1734 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:10:31.294904 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-851b6aef-5a8b-4d60-9b97-c85b692a5fbc tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:31.295661 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-851b6aef-5a8b-4d60-9b97-c85b692a5fbc tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 81fe7593-66bc-442e-bd42-67dbb727a356] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:31.308192 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-851b6aef-5a8b-4d60-9b97-c85b692a5fbc tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:31.309016 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-851b6aef-5a8b-4d60-9b97-c85b692a5fbc tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:31.309764 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-851b6aef-5a8b-4d60-9b97-c85b692a5fbc tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:31.311027 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-851b6aef-5a8b-4d60-9b97-c85b692a5fbc tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:31.311847 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-851b6aef-5a8b-4d60-9b97-c85b692a5fbc tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:31.312595 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-851b6aef-5a8b-4d60-9b97-c85b692a5fbc tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:31.365853 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-851b6aef-5a8b-4d60-9b97-c85b692a5fbc tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 81fe7593-66bc-442e-bd42-67dbb727a356] Going to try to terminate instance {{(pid=121339) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:10:31.776925 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-851b6aef-5a8b-4d60-9b97-c85b692a5fbc tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "DELETE /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356" status: 204 len: 0 microversion: 2.1 time: 0.489597 Sep 01 14:10:31.777761 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 267/552] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 14:10:31 2022] DELETE /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:10:31.789027 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-61d04c53-721f-4c4e-9273-6e1810f1635b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:31.794953 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-61d04c53-721f-4c4e-9273-6e1810f1635b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 81fe7593-66bc-442e-bd42-67dbb727a356] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:31.798997 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-61d04c53-721f-4c4e-9273-6e1810f1635b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:31.799639 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-61d04c53-721f-4c4e-9273-6e1810f1635b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:31.800188 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-61d04c53-721f-4c4e-9273-6e1810f1635b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:31.801155 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-61d04c53-721f-4c4e-9273-6e1810f1635b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:31.801806 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-61d04c53-721f-4c4e-9273-6e1810f1635b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:31.802376 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-61d04c53-721f-4c4e-9273-6e1810f1635b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:31.838905 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-797708a1-492f-4dda-8843-99565a152a63 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:31.840499 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-797708a1-492f-4dda-8843-99565a152a63 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:31.882963 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-797708a1-492f-4dda-8843-99565a152a63 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:31.883775 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-797708a1-492f-4dda-8843-99565a152a63 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:31.884217 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-797708a1-492f-4dda-8843-99565a152a63 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:31.884944 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-797708a1-492f-4dda-8843-99565a152a63 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:31.885402 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-797708a1-492f-4dda-8843-99565a152a63 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:31.885824 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-797708a1-492f-4dda-8843-99565a152a63 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:32.047254 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-61d04c53-721f-4c4e-9273-6e1810f1635b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53d275b44a2432a9fe8611304bcfa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d998735c243c3bcd08ca2e2d81ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:32.062256 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-61d04c53-721f-4c4e-9273-6e1810f1635b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356" status: 200 len: 1515 microversion: 2.1 time: 0.276991 Sep 01 14:10:32.074169 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 286/553] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:31 2022] GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356 => generated 1515 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:10:32.074169 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-61878d68-3907-4e1c-89dc-d70cd3350fb0 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:32.074169 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-61878d68-3907-4e1c-89dc-d70cd3350fb0 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:32.084165 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-797708a1-492f-4dda-8843-99565a152a63 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:32.085743 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-61878d68-3907-4e1c-89dc-d70cd3350fb0 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:32.086470 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-61878d68-3907-4e1c-89dc-d70cd3350fb0 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:32.086946 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-61878d68-3907-4e1c-89dc-d70cd3350fb0 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:32.087916 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-61878d68-3907-4e1c-89dc-d70cd3350fb0 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:32.088388 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-61878d68-3907-4e1c-89dc-d70cd3350fb0 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:32.088825 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-61878d68-3907-4e1c-89dc-d70cd3350fb0 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:32.098713 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-797708a1-492f-4dda-8843-99565a152a63 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1549 microversion: 2.1 time: 0.268081 Sep 01 14:10:32.099713 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 268/554] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:31 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1549 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:32.137454 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-27a23ea8-3be4-42bf-94fa-a4feb335d568 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:32.138399 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-27a23ea8-3be4-42bf-94fa-a4feb335d568 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:32.149763 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-27a23ea8-3be4-42bf-94fa-a4feb335d568 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:32.150604 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-27a23ea8-3be4-42bf-94fa-a4feb335d568 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:32.151321 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-27a23ea8-3be4-42bf-94fa-a4feb335d568 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:32.152445 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-27a23ea8-3be4-42bf-94fa-a4feb335d568 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:32.153251 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-27a23ea8-3be4-42bf-94fa-a4feb335d568 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:32.154004 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-27a23ea8-3be4-42bf-94fa-a4feb335d568 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:32.279670 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-61878d68-3907-4e1c-89dc-d70cd3350fb0 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:32.290703 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-61878d68-3907-4e1c-89dc-d70cd3350fb0 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1734 microversion: 2.1 time: 0.225928 Sep 01 14:10:32.302178 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 287/555] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:32 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1734 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:32.302178 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-204a675d-9beb-4b10-b563-d90d1bccf8b2 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:32.302178 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-204a675d-9beb-4b10-b563-d90d1bccf8b2 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:32.303449 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-204a675d-9beb-4b10-b563-d90d1bccf8b2 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:32.304143 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-204a675d-9beb-4b10-b563-d90d1bccf8b2 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:32.304861 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-204a675d-9beb-4b10-b563-d90d1bccf8b2 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:32.305581 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-204a675d-9beb-4b10-b563-d90d1bccf8b2 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:32.306261 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-204a675d-9beb-4b10-b563-d90d1bccf8b2 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:32.306680 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-204a675d-9beb-4b10-b563-d90d1bccf8b2 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:32.345156 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-204a675d-9beb-4b10-b563-d90d1bccf8b2 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71/os-volume_attachments/92ffabaa-1bd2-463b-a43e-04de46cdded6" status: 200 len: 194 microversion: 2.20 time: 0.052429 Sep 01 14:10:32.346287 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 288/556] 10.222.0.25 () {60 vars in 1454 bytes} [Thu Sep 1 14:10:32 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71/os-volume_attachments/92ffabaa-1bd2-463b-a43e-04de46cdded6 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 14:10:32.364770 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-27a23ea8-3be4-42bf-94fa-a4feb335d568 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:32.378842 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-27a23ea8-3be4-42bf-94fa-a4feb335d568 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1549 microversion: 2.1 time: 0.248517 Sep 01 14:10:32.379823 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 269/557] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:32 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1549 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:32.414965 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-fc0d2ddc-08bc-43f0-87c0-73ba532ee1f9 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:32.424559 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-fc0d2ddc-08bc-43f0-87c0-73ba532ee1f9 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:32.426283 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-fc0d2ddc-08bc-43f0-87c0-73ba532ee1f9 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Searching by: {'deleted': False, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143'} {{(pid=121340) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 14:10:32.438009 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-fc0d2ddc-08bc-43f0-87c0-73ba532ee1f9 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:32.439422 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-fc0d2ddc-08bc-43f0-87c0-73ba532ee1f9 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:32.440413 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-fc0d2ddc-08bc-43f0-87c0-73ba532ee1f9 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:32.441862 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-fc0d2ddc-08bc-43f0-87c0-73ba532ee1f9 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:32.442752 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-fc0d2ddc-08bc-43f0-87c0-73ba532ee1f9 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:32.443541 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-fc0d2ddc-08bc-43f0-87c0-73ba532ee1f9 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:32.472021 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-53716917-425e-4d20-9b54-10f4afb001a1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:32.472812 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-53716917-425e-4d20-9b54-10f4afb001a1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:32.483379 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-53716917-425e-4d20-9b54-10f4afb001a1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:32.484194 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-53716917-425e-4d20-9b54-10f4afb001a1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:32.484930 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-53716917-425e-4d20-9b54-10f4afb001a1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:32.486662 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-53716917-425e-4d20-9b54-10f4afb001a1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:32.487065 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-53716917-425e-4d20-9b54-10f4afb001a1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:32.487786 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-53716917-425e-4d20-9b54-10f4afb001a1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:32.615475 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.multi_cell_list [None req-fc0d2ddc-08bc-43f0-87c0-73ba532ee1f9 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121340) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 14:10:32.630889 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.objects.instance [None req-53716917-425e-4d20-9b54-10f4afb001a1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lazy-loading 'services' on Instance uuid d39f7090-b419-46be-9fcc-7ae73004ab71 {{(pid=121339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:10:32.720896 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-fc0d2ddc-08bc-43f0-87c0-73ba532ee1f9 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.312440 Sep 01 14:10:32.721707 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 289/558] 10.222.0.25 () {58 vars in 1125 bytes} [Thu Sep 1 14:10:32 2022] GET /compute/v2.1/servers => generated 342 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:10:32.733170 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-5478f414-3db8-41df-93a1-bdbf51b29a9d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:32.737870 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-5478f414-3db8-41df-93a1-bdbf51b29a9d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:32.740782 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5478f414-3db8-41df-93a1-bdbf51b29a9d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:32.741274 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5478f414-3db8-41df-93a1-bdbf51b29a9d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:32.741712 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5478f414-3db8-41df-93a1-bdbf51b29a9d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:32.742469 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5478f414-3db8-41df-93a1-bdbf51b29a9d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:32.742921 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5478f414-3db8-41df-93a1-bdbf51b29a9d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:32.743348 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5478f414-3db8-41df-93a1-bdbf51b29a9d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:32.760650 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell1:SELECT=100 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:10:32.929618 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-53716917-425e-4d20-9b54-10f4afb001a1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71/os-volume_attachments/92ffabaa-1bd2-463b-a43e-04de46cdded6" status: 202 len: 0 microversion: 2.20 time: 0.464302 Sep 01 14:10:32.930646 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 270/559] 10.222.0.25 () {60 vars in 1457 bytes} [Thu Sep 1 14:10:32 2022] DELETE /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71/os-volume_attachments/92ffabaa-1bd2-463b-a43e-04de46cdded6 => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:10:32.937637 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-5478f414-3db8-41df-93a1-bdbf51b29a9d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:32.945738 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-89b4cf6c-3cd1-4f57-9fd6-05f0565f40e6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:32.946803 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-5478f414-3db8-41df-93a1-bdbf51b29a9d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1549 microversion: 2.1 time: 0.217607 Sep 01 14:10:32.947412 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 290/560] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:32 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1549 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:10:32.950472 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-89b4cf6c-3cd1-4f57-9fd6-05f0565f40e6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:32.963457 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-89b4cf6c-3cd1-4f57-9fd6-05f0565f40e6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:32.964534 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-89b4cf6c-3cd1-4f57-9fd6-05f0565f40e6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:32.965358 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-89b4cf6c-3cd1-4f57-9fd6-05f0565f40e6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:32.966986 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-89b4cf6c-3cd1-4f57-9fd6-05f0565f40e6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:32.967913 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-89b4cf6c-3cd1-4f57-9fd6-05f0565f40e6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:32.968659 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-89b4cf6c-3cd1-4f57-9fd6-05f0565f40e6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:33.024323 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-89b4cf6c-3cd1-4f57-9fd6-05f0565f40e6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.088132 Sep 01 14:10:33.025030 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 271/561] 10.222.0.25 () {60 vars in 1343 bytes} [Thu Sep 1 14:10:32 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 14:10:33.092290 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-a1672036-d888-4df1-89b1-dc49d5f62fd4 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:33.093170 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-a1672036-d888-4df1-89b1-dc49d5f62fd4 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 81fe7593-66bc-442e-bd42-67dbb727a356] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:33.103104 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a1672036-d888-4df1-89b1-dc49d5f62fd4 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:33.104110 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a1672036-d888-4df1-89b1-dc49d5f62fd4 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:33.104719 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a1672036-d888-4df1-89b1-dc49d5f62fd4 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:33.105608 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a1672036-d888-4df1-89b1-dc49d5f62fd4 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:33.106290 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a1672036-d888-4df1-89b1-dc49d5f62fd4 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:33.106865 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a1672036-d888-4df1-89b1-dc49d5f62fd4 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:33.273927 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-a1672036-d888-4df1-89b1-dc49d5f62fd4 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53d275b44a2432a9fe8611304bcfa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d998735c243c3bcd08ca2e2d81ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:33.289118 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-a1672036-d888-4df1-89b1-dc49d5f62fd4 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356" status: 200 len: 1515 microversion: 2.1 time: 0.203144 Sep 01 14:10:33.290181 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 291/562] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:33 2022] GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356 => generated 1515 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:33.329154 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-5b6c8832-a996-4cea-973c-4cab5eafca7e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:33.330887 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-5b6c8832-a996-4cea-973c-4cab5eafca7e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:33.344042 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5b6c8832-a996-4cea-973c-4cab5eafca7e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:33.344042 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5b6c8832-a996-4cea-973c-4cab5eafca7e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:33.344533 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5b6c8832-a996-4cea-973c-4cab5eafca7e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:33.345852 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5b6c8832-a996-4cea-973c-4cab5eafca7e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:33.346706 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5b6c8832-a996-4cea-973c-4cab5eafca7e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:33.347460 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5b6c8832-a996-4cea-973c-4cab5eafca7e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:33.530497 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-5b6c8832-a996-4cea-973c-4cab5eafca7e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:33.545838 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-5b6c8832-a996-4cea-973c-4cab5eafca7e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1734 microversion: 2.1 time: 0.223896 Sep 01 14:10:33.546895 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 272/563] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:33 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1734 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:34.041797 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-a48c1b08-ec68-4b17-b6f5-3c566d5fc1b8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:34.045632 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-a48c1b08-ec68-4b17-b6f5-3c566d5fc1b8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:34.058243 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a48c1b08-ec68-4b17-b6f5-3c566d5fc1b8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:34.059104 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a48c1b08-ec68-4b17-b6f5-3c566d5fc1b8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:34.059875 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a48c1b08-ec68-4b17-b6f5-3c566d5fc1b8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:34.061098 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a48c1b08-ec68-4b17-b6f5-3c566d5fc1b8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:34.061890 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a48c1b08-ec68-4b17-b6f5-3c566d5fc1b8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:34.062659 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a48c1b08-ec68-4b17-b6f5-3c566d5fc1b8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:34.121319 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-a48c1b08-ec68-4b17-b6f5-3c566d5fc1b8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.086922 Sep 01 14:10:34.122432 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 292/564] 10.222.0.25 () {60 vars in 1343 bytes} [Thu Sep 1 14:10:34 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 14:10:34.329768 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-33e0e3d8-3353-42a6-a2b2-e6d1c291db20 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:34.333374 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-33e0e3d8-3353-42a6-a2b2-e6d1c291db20 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 81fe7593-66bc-442e-bd42-67dbb727a356] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:34.346688 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-33e0e3d8-3353-42a6-a2b2-e6d1c291db20 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:34.347552 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-33e0e3d8-3353-42a6-a2b2-e6d1c291db20 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:34.348458 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-33e0e3d8-3353-42a6-a2b2-e6d1c291db20 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:34.349588 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-33e0e3d8-3353-42a6-a2b2-e6d1c291db20 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:34.350402 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-33e0e3d8-3353-42a6-a2b2-e6d1c291db20 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:34.351180 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-33e0e3d8-3353-42a6-a2b2-e6d1c291db20 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:34.576255 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-84631b00-bb75-4e61-b9c7-905aa28d2894 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:34.578023 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-84631b00-bb75-4e61-b9c7-905aa28d2894 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:34.596062 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-84631b00-bb75-4e61-b9c7-905aa28d2894 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:34.596822 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-84631b00-bb75-4e61-b9c7-905aa28d2894 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:34.597572 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-84631b00-bb75-4e61-b9c7-905aa28d2894 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:34.598774 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-84631b00-bb75-4e61-b9c7-905aa28d2894 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:34.599486 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-84631b00-bb75-4e61-b9c7-905aa28d2894 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:34.600206 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-84631b00-bb75-4e61-b9c7-905aa28d2894 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:34.717598 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-33e0e3d8-3353-42a6-a2b2-e6d1c291db20 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53d275b44a2432a9fe8611304bcfa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d998735c243c3bcd08ca2e2d81ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:34.727661 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-33e0e3d8-3353-42a6-a2b2-e6d1c291db20 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356" status: 200 len: 1515 microversion: 2.1 time: 0.405991 Sep 01 14:10:34.728300 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 273/565] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:34 2022] GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356 => generated 1515 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:34.868569 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-84631b00-bb75-4e61-b9c7-905aa28d2894 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:34.885523 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-84631b00-bb75-4e61-b9c7-905aa28d2894 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1734 microversion: 2.1 time: 0.315009 Sep 01 14:10:34.886248 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 293/566] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:34 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1734 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:35.155956 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-d7a41073-45e2-4465-ab94-2a284c0fe840 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:35.162680 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-d7a41073-45e2-4465-ab94-2a284c0fe840 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:35.163846 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [req-ae6d7e00-46a4-4ebd-967a-de531385753e req-91cf1f7f-ae6e-419f-8fc6-eb671f8e0c38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81fe7593-66bc-442e-bd42-67dbb727a356", "name": "network-vif-deleted", "tag": "cbd0d6ee-8ef6-4903-9342-88e28ddb8597"}]} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:10:35.183405 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d7a41073-45e2-4465-ab94-2a284c0fe840 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:35.183664 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-ae6d7e00-46a4-4ebd-967a-de531385753e req-91cf1f7f-ae6e-419f-8fc6-eb671f8e0c38 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:35.184254 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d7a41073-45e2-4465-ab94-2a284c0fe840 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:35.184572 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-ae6d7e00-46a4-4ebd-967a-de531385753e req-91cf1f7f-ae6e-419f-8fc6-eb671f8e0c38 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:35.185921 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-ae6d7e00-46a4-4ebd-967a-de531385753e req-91cf1f7f-ae6e-419f-8fc6-eb671f8e0c38 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:35.190229 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d7a41073-45e2-4465-ab94-2a284c0fe840 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:35.191132 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d7a41073-45e2-4465-ab94-2a284c0fe840 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:35.191768 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d7a41073-45e2-4465-ab94-2a284c0fe840 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:35.192473 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d7a41073-45e2-4465-ab94-2a284c0fe840 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:35.215315 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.compute.server_external_events [req-ae6d7e00-46a4-4ebd-967a-de531385753e req-91cf1f7f-ae6e-419f-8fc6-eb671f8e0c38 service nova] Creating event network-vif-deleted:cbd0d6ee-8ef6-4903-9342-88e28ddb8597 for instance 81fe7593-66bc-442e-bd42-67dbb727a356 on hv-cinder-85221 Sep 01 14:10:35.227461 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [req-ae6d7e00-46a4-4ebd-967a-de531385753e req-91cf1f7f-ae6e-419f-8fc6-eb671f8e0c38 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071066 Sep 01 14:10:35.229075 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 294/567] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:10:35.255322 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-d7a41073-45e2-4465-ab94-2a284c0fe840 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.120073 Sep 01 14:10:35.256046 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 274/568] 10.222.0.25 () {60 vars in 1343 bytes} [Thu Sep 1 14:10:35 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 14:10:35.276352 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-6d49999d-01e7-4d7a-ad9e-1727d24241f9 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2dfc3261-54cf-4572-94ae-2542264170a8"}} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:10:35.279658 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-6d49999d-01e7-4d7a-ad9e-1727d24241f9 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:35.288557 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6d49999d-01e7-4d7a-ad9e-1727d24241f9 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:35.289209 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6d49999d-01e7-4d7a-ad9e-1727d24241f9 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:35.289847 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6d49999d-01e7-4d7a-ad9e-1727d24241f9 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:35.290823 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6d49999d-01e7-4d7a-ad9e-1727d24241f9 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:35.291574 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6d49999d-01e7-4d7a-ad9e-1727d24241f9 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:35.292119 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6d49999d-01e7-4d7a-ad9e-1727d24241f9 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:35.770103 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-e5c562d0-cb77-458c-b051-e7c761e15913 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:35.770957 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-e5c562d0-cb77-458c-b051-e7c761e15913 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 81fe7593-66bc-442e-bd42-67dbb727a356] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:35.777592 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e5c562d0-cb77-458c-b051-e7c761e15913 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:35.778120 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e5c562d0-cb77-458c-b051-e7c761e15913 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:35.778548 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e5c562d0-cb77-458c-b051-e7c761e15913 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:35.779253 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e5c562d0-cb77-458c-b051-e7c761e15913 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:35.779700 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e5c562d0-cb77-458c-b051-e7c761e15913 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:35.780118 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e5c562d0-cb77-458c-b051-e7c761e15913 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:35.816963 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e5c562d0-cb77-458c-b051-e7c761e15913 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:35.817449 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e5c562d0-cb77-458c-b051-e7c761e15913 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:35.817886 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e5c562d0-cb77-458c-b051-e7c761e15913 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:35.818386 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.objects.instance [None req-e5c562d0-cb77-458c-b051-e7c761e15913 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lazy-loading 'fault' on Instance uuid 81fe7593-66bc-442e-bd42-67dbb727a356 {{(pid=121339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:10:35.872134 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-e5c562d0-cb77-458c-b051-e7c761e15913 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53d275b44a2432a9fe8611304bcfa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d998735c243c3bcd08ca2e2d81ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:35.883480 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-e5c562d0-cb77-458c-b051-e7c761e15913 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356" status: 200 len: 1309 microversion: 2.1 time: 0.118349 Sep 01 14:10:35.884384 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 275/569] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:35 2022] GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356 => generated 1309 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:10:35.917222 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-328509cc-c614-4507-8425-3745f6f9c288 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:35.918224 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-328509cc-c614-4507-8425-3745f6f9c288 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:35.928815 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-328509cc-c614-4507-8425-3745f6f9c288 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:35.929711 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-328509cc-c614-4507-8425-3745f6f9c288 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:35.930469 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-328509cc-c614-4507-8425-3745f6f9c288 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:35.931852 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-328509cc-c614-4507-8425-3745f6f9c288 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:35.932619 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-328509cc-c614-4507-8425-3745f6f9c288 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:35.933328 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-328509cc-c614-4507-8425-3745f6f9c288 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:36.116273 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-328509cc-c614-4507-8425-3745f6f9c288 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:36.124819 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-328509cc-c614-4507-8425-3745f6f9c288 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1734 microversion: 2.1 time: 0.212036 Sep 01 14:10:36.125438 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 276/570] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:35 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1734 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:10:36.272135 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-a8b9c118-68d2-4be9-8ba2-e09a7f68b8d9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:36.274595 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-a8b9c118-68d2-4be9-8ba2-e09a7f68b8d9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:36.280851 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a8b9c118-68d2-4be9-8ba2-e09a7f68b8d9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:36.281342 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a8b9c118-68d2-4be9-8ba2-e09a7f68b8d9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:36.281778 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a8b9c118-68d2-4be9-8ba2-e09a7f68b8d9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:36.282529 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a8b9c118-68d2-4be9-8ba2-e09a7f68b8d9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:36.283693 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a8b9c118-68d2-4be9-8ba2-e09a7f68b8d9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:36.284131 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a8b9c118-68d2-4be9-8ba2-e09a7f68b8d9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:36.319705 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-a8b9c118-68d2-4be9-8ba2-e09a7f68b8d9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052689 Sep 01 14:10:36.337676 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 277/571] 10.222.0.25 () {60 vars in 1343 bytes} [Thu Sep 1 14:10:36 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:10:36.393550 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-1cd846c7-abef-4e60-b4ea-816b033278bd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:36.394169 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-1cd846c7-abef-4e60-b4ea-816b033278bd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:36.402386 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1cd846c7-abef-4e60-b4ea-816b033278bd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:36.403292 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1cd846c7-abef-4e60-b4ea-816b033278bd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:36.403292 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1cd846c7-abef-4e60-b4ea-816b033278bd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:36.403998 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1cd846c7-abef-4e60-b4ea-816b033278bd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:36.404451 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1cd846c7-abef-4e60-b4ea-816b033278bd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:36.404880 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1cd846c7-abef-4e60-b4ea-816b033278bd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:36.434675 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-1cd846c7-abef-4e60-b4ea-816b033278bd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Going to try to terminate instance {{(pid=121339) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:10:36.683409 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-6d49999d-01e7-4d7a-ad9e-1727d24241f9 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "POST /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.412532 Sep 01 14:10:36.684573 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 295/572] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Sep 1 14:10:35 2022] POST /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a/os-volume_attachments => generated 194 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:10:36.690228 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:10:36.920402 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-638ee45d-0acd-4161-9482-12cb5daf4184 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:36.921474 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-638ee45d-0acd-4161-9482-12cb5daf4184 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 81fe7593-66bc-442e-bd42-67dbb727a356] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:36.934686 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-638ee45d-0acd-4161-9482-12cb5daf4184 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:36.935499 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-638ee45d-0acd-4161-9482-12cb5daf4184 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:36.936141 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-638ee45d-0acd-4161-9482-12cb5daf4184 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:36.937151 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-638ee45d-0acd-4161-9482-12cb5daf4184 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:36.937852 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-638ee45d-0acd-4161-9482-12cb5daf4184 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:36.938818 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-638ee45d-0acd-4161-9482-12cb5daf4184 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:36.948183 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-1cd846c7-abef-4e60-b4ea-816b033278bd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 204 len: 0 microversion: 2.20 time: 0.557407 Sep 01 14:10:36.950575 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 278/573] 10.222.0.25 () {60 vars in 1280 bytes} [Thu Sep 1 14:10:36 2022] DELETE /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 01 14:10:36.964921 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-4d654eb8-f37a-49fe-bb8d-02ec6a2f849a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:36.965626 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-4d654eb8-f37a-49fe-bb8d-02ec6a2f849a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:36.973404 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4d654eb8-f37a-49fe-bb8d-02ec6a2f849a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:36.974227 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4d654eb8-f37a-49fe-bb8d-02ec6a2f849a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:36.974824 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4d654eb8-f37a-49fe-bb8d-02ec6a2f849a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:36.975697 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4d654eb8-f37a-49fe-bb8d-02ec6a2f849a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:36.976328 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4d654eb8-f37a-49fe-bb8d-02ec6a2f849a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:36.976957 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4d654eb8-f37a-49fe-bb8d-02ec6a2f849a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:37.009585 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-638ee45d-0acd-4161-9482-12cb5daf4184 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:37.010590 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-638ee45d-0acd-4161-9482-12cb5daf4184 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:37.011661 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-638ee45d-0acd-4161-9482-12cb5daf4184 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:37.012542 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.objects.instance [None req-638ee45d-0acd-4161-9482-12cb5daf4184 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lazy-loading 'fault' on Instance uuid 81fe7593-66bc-442e-bd42-67dbb727a356 {{(pid=121340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:10:37.117770 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-638ee45d-0acd-4161-9482-12cb5daf4184 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53d275b44a2432a9fe8611304bcfa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d998735c243c3bcd08ca2e2d81ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:37.125425 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-638ee45d-0acd-4161-9482-12cb5daf4184 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356" status: 200 len: 1309 microversion: 2.1 time: 0.211185 Sep 01 14:10:37.138957 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 296/574] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:36 2022] GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356 => generated 1309 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:10:37.148442 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-134f3803-95da-417c-90bd-dccb4164f6d4 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:37.149043 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-134f3803-95da-417c-90bd-dccb4164f6d4 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:37.156446 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-134f3803-95da-417c-90bd-dccb4164f6d4 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:37.157069 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-134f3803-95da-417c-90bd-dccb4164f6d4 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:37.158279 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-134f3803-95da-417c-90bd-dccb4164f6d4 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:37.159173 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-134f3803-95da-417c-90bd-dccb4164f6d4 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:37.159862 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-134f3803-95da-417c-90bd-dccb4164f6d4 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:37.160509 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-134f3803-95da-417c-90bd-dccb4164f6d4 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:37.266135 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-4d654eb8-f37a-49fe-bb8d-02ec6a2f849a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:37.277260 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-4d654eb8-f37a-49fe-bb8d-02ec6a2f849a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:37.278931 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-4d654eb8-f37a-49fe-bb8d-02ec6a2f849a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:37.280154 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-4d654eb8-f37a-49fe-bb8d-02ec6a2f849a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1725 microversion: 2.20 time: 0.322866 Sep 01 14:10:37.280736 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 279/575] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:10:36 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1725 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:10:37.351052 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-134f3803-95da-417c-90bd-dccb4164f6d4 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:37.360255 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-134f3803-95da-417c-90bd-dccb4164f6d4 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1734 microversion: 2.1 time: 0.215810 Sep 01 14:10:37.369555 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 297/576] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:37 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1734 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:10:38.148267 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-2ec0a9b0-d90e-4d3d-8fc6-04ac7782127b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:38.148885 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-2ec0a9b0-d90e-4d3d-8fc6-04ac7782127b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 81fe7593-66bc-442e-bd42-67dbb727a356] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:38.159490 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2ec0a9b0-d90e-4d3d-8fc6-04ac7782127b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:38.160410 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2ec0a9b0-d90e-4d3d-8fc6-04ac7782127b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:38.161233 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2ec0a9b0-d90e-4d3d-8fc6-04ac7782127b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:38.162510 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2ec0a9b0-d90e-4d3d-8fc6-04ac7782127b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:38.163348 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2ec0a9b0-d90e-4d3d-8fc6-04ac7782127b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:38.164129 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2ec0a9b0-d90e-4d3d-8fc6-04ac7782127b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:38.184481 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.wsgi [None req-2ec0a9b0-d90e-4d3d-8fc6-04ac7782127b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] HTTP exception thrown: Instance 81fe7593-66bc-442e-bd42-67dbb727a356 could not be found. Sep 01 14:10:38.186207 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-2ec0a9b0-d90e-4d3d-8fc6-04ac7782127b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Request method failure captured: Sep 01 14:10:38.186207 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: request: GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356 HTTP/1.1 Sep 01 14:10:38.186207 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept: application/json Sep 01 14:10:38.186207 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept-Encoding: identity Sep 01 14:10:38.186207 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Connection: close Sep 01 14:10:38.186207 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Length: 0 Sep 01 14:10:38.186207 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Type: application/json Sep 01 14:10:38.186207 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Host: 10.222.0.25 Sep 01 14:10:38.186207 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Openstack-System-Scope: None Sep 01 14:10:38.186207 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: User-Agent: python-urllib3/1.26.12 Sep 01 14:10:38.186207 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Auth-Token: gAAAAABjELzjEL45kBu57JcOMhdZVwX8Tzj_dwUxCCD8CHaWOSaeaAl3HeTTZKSArltoTBZ_eOIg3IYKvjCVLdQBKV-4knMNeR6qNTEUaPof_3m6ww0GhE6XpDW_NuH3FOT6ReURdop0YXGIoxI6K8dXBTpwPdCE3bUvEHf2gzfaoSiYMzlD1GE Sep 01 14:10:38.186207 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Id: None Sep 01 14:10:38.186207 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Name: None Sep 01 14:10:38.186207 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Identity-Status: Confirmed Sep 01 14:10:38.186207 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Is-Admin-Project: True Sep 01 14:10:38.186207 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Id: default Sep 01 14:10:38.186207 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Name: Default Sep 01 14:10:38.186207 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Id: 2e6d998735c243c3bcd08ca2e2d81ae9 Sep 01 14:10:38.186207 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Name: tempest-VolumesSnapshotTestJSON-127143842 Sep 01 14:10:38.186207 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Role: member,reader Sep 01 14:10:38.186207 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Roles: member,reader Sep 01 14:10:38.189193 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2e6d998735c243c3bcd08ca2e2d81ae9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2e6d998735c243c3bcd08ca2e2d81ae9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2e6d998735c243c3bcd08ca2e2d81ae9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2e6d998735c243c3bcd08ca2e2d81ae9"}]}] Sep 01 14:10:38.189193 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant: tempest-VolumesSnapshotTestJSON-127143842 Sep 01 14:10:38.189193 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Id: 2e6d998735c243c3bcd08ca2e2d81ae9 Sep 01 14:10:38.189193 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-127143842 Sep 01 14:10:38.189193 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User: tempest-VolumesSnapshotTestJSON-127143842-project Sep 01 14:10:38.189193 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Id: default Sep 01 14:10:38.189193 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Name: Default Sep 01 14:10:38.189193 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Id: e53d275b44a2432a9fe8611304bcfa91 Sep 01 14:10:38.189193 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Name: tempest-VolumesSnapshotTestJSON-127143842-project Sep 01 14:10:38.189193 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: method: > Sep 01 14:10:38.189193 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: exception: Instance 81fe7593-66bc-442e-bd42-67dbb727a356 could not be found. Sep 01 14:10:38.189193 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: action_args: {'id': '81fe7593-66bc-442e-bd42-67dbb727a356'} Sep 01 14:10:38.191102 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:10:38.191102 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:10:38.191102 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:10:38.191102 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:10:38.191102 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:10:38.191102 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:10:38.191102 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:10:38.191102 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:10:38.191102 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:10:38.191102 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:10:38.191102 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81fe7593-66bc-442e-bd42-67dbb727a356 could not be found. Sep 01 14:10:38.191102 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:10:38.191102 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:10:38.191102 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:10:38.191102 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:10:38.191102 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:10:38.191102 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:10:38.191102 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:10:38.191102 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:10:38.191102 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:10:38.193835 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:10:38.193835 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:10:38.193835 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:10:38.193835 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:10:38.193835 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:10:38.193835 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:10:38.193835 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:10:38.193835 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81fe7593-66bc-442e-bd42-67dbb727a356 could not be found. Sep 01 14:10:38.193835 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:10:38.193835 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:10:38.193835 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:10:38.193835 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:10:38.193835 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:10:38.193835 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:10:38.193835 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:10:38.193835 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:10:38.193835 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81fe7593-66bc-442e-bd42-67dbb727a356 could not be found. Sep 01 14:10:38.193835 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:10:38.196231 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-2ec0a9b0-d90e-4d3d-8fc6-04ac7782127b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Returning 404 to user: Instance 81fe7593-66bc-442e-bd42-67dbb727a356 could not be found. {{(pid=121339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:10:38.196231 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-2ec0a9b0-d90e-4d3d-8fc6-04ac7782127b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356" status: 404 len: 111 microversion: 2.1 time: 0.043467 Sep 01 14:10:38.196231 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 280/577] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:38 2022] GET /compute/v2.1/servers/81fe7593-66bc-442e-bd42-67dbb727a356 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:10:38.306102 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-6faca45b-210a-447c-9633-d89678010e28 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:38.306841 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-6faca45b-210a-447c-9633-d89678010e28 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:38.310441 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_api:SELECT=64 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:10:38.316250 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6faca45b-210a-447c-9633-d89678010e28 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:38.316735 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6faca45b-210a-447c-9633-d89678010e28 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:38.317162 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6faca45b-210a-447c-9633-d89678010e28 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:38.317871 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6faca45b-210a-447c-9633-d89678010e28 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:38.318353 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6faca45b-210a-447c-9633-d89678010e28 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:38.318772 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6faca45b-210a-447c-9633-d89678010e28 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:38.387108 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-5ed25bcd-d4a4-4ba7-8809-8dfa536da0c4 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:38.388456 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-5ed25bcd-d4a4-4ba7-8809-8dfa536da0c4 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:38.401520 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5ed25bcd-d4a4-4ba7-8809-8dfa536da0c4 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:38.402340 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5ed25bcd-d4a4-4ba7-8809-8dfa536da0c4 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:38.403138 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5ed25bcd-d4a4-4ba7-8809-8dfa536da0c4 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:38.404484 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5ed25bcd-d4a4-4ba7-8809-8dfa536da0c4 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:38.405412 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5ed25bcd-d4a4-4ba7-8809-8dfa536da0c4 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:38.406256 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5ed25bcd-d4a4-4ba7-8809-8dfa536da0c4 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:38.511024 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-6faca45b-210a-447c-9633-d89678010e28 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:38.523287 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-6faca45b-210a-447c-9633-d89678010e28 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:38.525844 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-6faca45b-210a-447c-9633-d89678010e28 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:38.527863 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-6faca45b-210a-447c-9633-d89678010e28 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1725 microversion: 2.20 time: 0.225409 Sep 01 14:10:38.528446 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 298/578] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:10:38 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1725 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:10:38.745508 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-5ed25bcd-d4a4-4ba7-8809-8dfa536da0c4 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:38.758689 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-5ed25bcd-d4a4-4ba7-8809-8dfa536da0c4 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1734 microversion: 2.1 time: 0.378790 Sep 01 14:10:38.761353 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 281/579] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:38 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1734 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:10:39.553231 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-ffc9fc1d-6173-41ab-9407-bc022f6ed785 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:39.554084 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-ffc9fc1d-6173-41ab-9407-bc022f6ed785 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:39.560893 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ffc9fc1d-6173-41ab-9407-bc022f6ed785 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:39.561409 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ffc9fc1d-6173-41ab-9407-bc022f6ed785 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:39.561853 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ffc9fc1d-6173-41ab-9407-bc022f6ed785 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:39.562597 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ffc9fc1d-6173-41ab-9407-bc022f6ed785 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:39.563052 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ffc9fc1d-6173-41ab-9407-bc022f6ed785 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:39.563476 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ffc9fc1d-6173-41ab-9407-bc022f6ed785 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:39.797177 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-40f016ce-b3aa-4c11-8522-9a8553a4ae90 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:39.798103 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-40f016ce-b3aa-4c11-8522-9a8553a4ae90 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:39.806582 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-40f016ce-b3aa-4c11-8522-9a8553a4ae90 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:39.807179 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-40f016ce-b3aa-4c11-8522-9a8553a4ae90 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:39.807700 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-40f016ce-b3aa-4c11-8522-9a8553a4ae90 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:39.808891 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-40f016ce-b3aa-4c11-8522-9a8553a4ae90 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:39.809849 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-40f016ce-b3aa-4c11-8522-9a8553a4ae90 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:39.813547 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-40f016ce-b3aa-4c11-8522-9a8553a4ae90 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:40.140757 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-ffc9fc1d-6173-41ab-9407-bc022f6ed785 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:40.153210 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-ffc9fc1d-6173-41ab-9407-bc022f6ed785 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:40.155871 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-ffc9fc1d-6173-41ab-9407-bc022f6ed785 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:40.158705 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-ffc9fc1d-6173-41ab-9407-bc022f6ed785 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1725 microversion: 2.20 time: 0.608281 Sep 01 14:10:40.159315 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 299/580] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:10:39 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1725 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:10:40.180091 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-40f016ce-b3aa-4c11-8522-9a8553a4ae90 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:40.190838 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-40f016ce-b3aa-4c11-8522-9a8553a4ae90 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1734 microversion: 2.1 time: 0.397532 Sep 01 14:10:40.191596 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 282/581] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:39 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1734 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:10:40.614131 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [req-5dcbff57-987e-4db6-8f83-2a526a110b22 req-da853885-04d6-40d7-8df5-cfb282aa0c5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d39f7090-b419-46be-9fcc-7ae73004ab71", "name": "network-vif-deleted", "tag": "9ae4ab09-714c-4175-ba0d-7b76b31e652d"}]} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:10:40.621185 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-5dcbff57-987e-4db6-8f83-2a526a110b22 req-da853885-04d6-40d7-8df5-cfb282aa0c5f service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:40.622227 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-5dcbff57-987e-4db6-8f83-2a526a110b22 req-da853885-04d6-40d7-8df5-cfb282aa0c5f service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:40.623225 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-5dcbff57-987e-4db6-8f83-2a526a110b22 req-da853885-04d6-40d7-8df5-cfb282aa0c5f service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:40.637428 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.compute.server_external_events [req-5dcbff57-987e-4db6-8f83-2a526a110b22 req-da853885-04d6-40d7-8df5-cfb282aa0c5f service nova] Creating event network-vif-deleted:9ae4ab09-714c-4175-ba0d-7b76b31e652d for instance d39f7090-b419-46be-9fcc-7ae73004ab71 on hv-cinder-85221 Sep 01 14:10:40.643723 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [req-5dcbff57-987e-4db6-8f83-2a526a110b22 req-da853885-04d6-40d7-8df5-cfb282aa0c5f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052992 Sep 01 14:10:40.644456 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 300/582] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:10:41.205697 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-b4cb7b57-708a-4c6f-af91-e23f1c9b952a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:41.218082 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-00f569b6-c601-4b6b-8f21-4a0d36eaa956 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:41.219224 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-00f569b6-c601-4b6b-8f21-4a0d36eaa956 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:41.222718 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-b4cb7b57-708a-4c6f-af91-e23f1c9b952a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:41.240907 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b4cb7b57-708a-4c6f-af91-e23f1c9b952a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:41.241776 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b4cb7b57-708a-4c6f-af91-e23f1c9b952a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:41.242606 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b4cb7b57-708a-4c6f-af91-e23f1c9b952a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:41.243923 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b4cb7b57-708a-4c6f-af91-e23f1c9b952a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:41.244763 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b4cb7b57-708a-4c6f-af91-e23f1c9b952a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:41.245599 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b4cb7b57-708a-4c6f-af91-e23f1c9b952a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:41.253987 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-00f569b6-c601-4b6b-8f21-4a0d36eaa956 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:41.254882 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-00f569b6-c601-4b6b-8f21-4a0d36eaa956 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:41.255694 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-00f569b6-c601-4b6b-8f21-4a0d36eaa956 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:41.257071 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-00f569b6-c601-4b6b-8f21-4a0d36eaa956 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:41.257959 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-00f569b6-c601-4b6b-8f21-4a0d36eaa956 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:41.258753 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-00f569b6-c601-4b6b-8f21-4a0d36eaa956 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:41.382945 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-b4cb7b57-708a-4c6f-af91-e23f1c9b952a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:41.393323 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-b4cb7b57-708a-4c6f-af91-e23f1c9b952a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:41.395225 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-b4cb7b57-708a-4c6f-af91-e23f1c9b952a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:41.396568 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-b4cb7b57-708a-4c6f-af91-e23f1c9b952a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1657 microversion: 2.20 time: 0.199740 Sep 01 14:10:41.397643 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 283/583] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:10:41 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1657 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:10:41.616595 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-00f569b6-c601-4b6b-8f21-4a0d36eaa956 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:41.627730 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-00f569b6-c601-4b6b-8f21-4a0d36eaa956 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1734 microversion: 2.1 time: 0.417689 Sep 01 14:10:41.629199 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 301/584] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:41 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1734 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:42.440806 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-c8be97d2-6db8-4a0d-b534-0c87c263fe43 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:42.441535 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-c8be97d2-6db8-4a0d-b534-0c87c263fe43 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:42.450409 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c8be97d2-6db8-4a0d-b534-0c87c263fe43 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:42.450957 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c8be97d2-6db8-4a0d-b534-0c87c263fe43 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:42.451457 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c8be97d2-6db8-4a0d-b534-0c87c263fe43 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:42.452592 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c8be97d2-6db8-4a0d-b534-0c87c263fe43 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:42.453308 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c8be97d2-6db8-4a0d-b534-0c87c263fe43 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:42.455049 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c8be97d2-6db8-4a0d-b534-0c87c263fe43 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:42.516540 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c8be97d2-6db8-4a0d-b534-0c87c263fe43 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:42.518351 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c8be97d2-6db8-4a0d-b534-0c87c263fe43 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:42.519409 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c8be97d2-6db8-4a0d-b534-0c87c263fe43 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:42.520468 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.objects.instance [None req-c8be97d2-6db8-4a0d-b534-0c87c263fe43 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lazy-loading 'fault' on Instance uuid d39f7090-b419-46be-9fcc-7ae73004ab71 {{(pid=121339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:10:42.614123 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-c8be97d2-6db8-4a0d-b534-0c87c263fe43 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:42.626544 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-c8be97d2-6db8-4a0d-b534-0c87c263fe43 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:42.628793 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-c8be97d2-6db8-4a0d-b534-0c87c263fe43 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:42.631166 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-c8be97d2-6db8-4a0d-b534-0c87c263fe43 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1372 microversion: 2.20 time: 0.195959 Sep 01 14:10:42.649804 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 284/585] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:10:42 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1372 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:10:42.656373 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-bdc27372-34b4-48a0-8edf-a73c4ad43e43 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:42.657414 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-bdc27372-34b4-48a0-8edf-a73c4ad43e43 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:42.661825 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell0:SELECT=2 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:10:42.672786 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bdc27372-34b4-48a0-8edf-a73c4ad43e43 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:42.674300 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bdc27372-34b4-48a0-8edf-a73c4ad43e43 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:42.675115 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bdc27372-34b4-48a0-8edf-a73c4ad43e43 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:42.676686 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bdc27372-34b4-48a0-8edf-a73c4ad43e43 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:42.677469 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bdc27372-34b4-48a0-8edf-a73c4ad43e43 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:42.679007 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bdc27372-34b4-48a0-8edf-a73c4ad43e43 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:42.901696 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-bdc27372-34b4-48a0-8edf-a73c4ad43e43 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:42.911369 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-bdc27372-34b4-48a0-8edf-a73c4ad43e43 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1734 microversion: 2.1 time: 0.263936 Sep 01 14:10:42.911972 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 302/586] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:42 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1734 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:43.657085 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-8f2266c2-a775-4079-bc32-61c494b32916 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:43.658487 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-8f2266c2-a775-4079-bc32-61c494b32916 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:43.665768 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8f2266c2-a775-4079-bc32-61c494b32916 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:43.666306 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8f2266c2-a775-4079-bc32-61c494b32916 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:43.666743 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8f2266c2-a775-4079-bc32-61c494b32916 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:43.667455 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8f2266c2-a775-4079-bc32-61c494b32916 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:43.667911 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8f2266c2-a775-4079-bc32-61c494b32916 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:43.668356 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8f2266c2-a775-4079-bc32-61c494b32916 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:43.735557 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8f2266c2-a775-4079-bc32-61c494b32916 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:43.737296 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8f2266c2-a775-4079-bc32-61c494b32916 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:43.738147 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8f2266c2-a775-4079-bc32-61c494b32916 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:43.738979 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.objects.instance [None req-8f2266c2-a775-4079-bc32-61c494b32916 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lazy-loading 'fault' on Instance uuid d39f7090-b419-46be-9fcc-7ae73004ab71 {{(pid=121339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:10:43.801156 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-8f2266c2-a775-4079-bc32-61c494b32916 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:43.813163 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-8f2266c2-a775-4079-bc32-61c494b32916 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:43.816285 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-8f2266c2-a775-4079-bc32-61c494b32916 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:43.817888 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-8f2266c2-a775-4079-bc32-61c494b32916 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 200 len: 1372 microversion: 2.20 time: 0.164695 Sep 01 14:10:43.818913 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 285/587] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:10:43 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:10:43.934177 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-f97c5e0c-af54-40fa-91a3-e509aa192a94 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:43.934801 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-f97c5e0c-af54-40fa-91a3-e509aa192a94 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:43.942891 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f97c5e0c-af54-40fa-91a3-e509aa192a94 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:43.943707 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f97c5e0c-af54-40fa-91a3-e509aa192a94 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:43.944463 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f97c5e0c-af54-40fa-91a3-e509aa192a94 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:43.945258 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f97c5e0c-af54-40fa-91a3-e509aa192a94 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:43.945783 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f97c5e0c-af54-40fa-91a3-e509aa192a94 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:43.946329 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f97c5e0c-af54-40fa-91a3-e509aa192a94 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:44.137863 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-f97c5e0c-af54-40fa-91a3-e509aa192a94 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:44.147589 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-f97c5e0c-af54-40fa-91a3-e509aa192a94 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1734 microversion: 2.1 time: 0.218325 Sep 01 14:10:44.148356 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 303/588] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:43 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1734 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:44.845569 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-94b46707-b46e-4e08-b84f-5778e5d7f62a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:44.846700 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-94b46707-b46e-4e08-b84f-5778e5d7f62a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:44.854136 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-94b46707-b46e-4e08-b84f-5778e5d7f62a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:44.854801 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-94b46707-b46e-4e08-b84f-5778e5d7f62a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:44.855345 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-94b46707-b46e-4e08-b84f-5778e5d7f62a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:44.856170 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-94b46707-b46e-4e08-b84f-5778e5d7f62a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:44.856721 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-94b46707-b46e-4e08-b84f-5778e5d7f62a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:44.857241 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-94b46707-b46e-4e08-b84f-5778e5d7f62a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:44.873328 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.wsgi [None req-94b46707-b46e-4e08-b84f-5778e5d7f62a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] HTTP exception thrown: Instance d39f7090-b419-46be-9fcc-7ae73004ab71 could not be found. Sep 01 14:10:44.875001 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-94b46707-b46e-4e08-b84f-5778e5d7f62a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Request method failure captured: Sep 01 14:10:44.875001 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: request: GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 HTTP/1.1 Sep 01 14:10:44.875001 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept: application/json Sep 01 14:10:44.875001 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept-Encoding: identity Sep 01 14:10:44.875001 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Connection: close Sep 01 14:10:44.875001 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Length: 0 Sep 01 14:10:44.875001 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Type: application/json Sep 01 14:10:44.875001 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Host: 10.222.0.25 Sep 01 14:10:44.875001 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Openstack-System-Scope: None Sep 01 14:10:44.875001 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: User-Agent: python-urllib3/1.26.12 Sep 01 14:10:44.875001 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Auth-Token: gAAAAABjELxGu0o-Ahu0noh1p5LNsT5msZ4tN-YnSO48-fTSZmnLc3zyBdN_rOjOZVPe8mykmgxYKWEe_6hqOeRaaerWui5gZry7CjSC6FLfKNAlLYSbEfQUNKxvpckkW39tNrunRs6LiExWpLgF4-gJ99jz47GWL1H_XOmr_kT0sEHFyhyAooA Sep 01 14:10:44.875001 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Id: None Sep 01 14:10:44.875001 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Name: None Sep 01 14:10:44.875001 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Identity-Status: Confirmed Sep 01 14:10:44.875001 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Is-Admin-Project: True Sep 01 14:10:44.875001 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 14:10:44.875001 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Id: default Sep 01 14:10:44.875001 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Name: Default Sep 01 14:10:44.875001 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Id: 3ed58deb61194a5ba3f2d46eb7e5680c Sep 01 14:10:44.875001 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1249820830 Sep 01 14:10:44.875001 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Role: member,reader Sep 01 14:10:44.875001 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Roles: member,reader Sep 01 14:10:44.877480 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ed58deb61194a5ba3f2d46eb7e5680c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3ed58deb61194a5ba3f2d46eb7e5680c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ed58deb61194a5ba3f2d46eb7e5680c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3ed58deb61194a5ba3f2d46eb7e5680c"}]}] Sep 01 14:10:44.877480 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1249820830 Sep 01 14:10:44.877480 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Id: 3ed58deb61194a5ba3f2d46eb7e5680c Sep 01 14:10:44.877480 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1249820830 Sep 01 14:10:44.877480 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User: tempest-AttachVolumeShelveTestJSON-1249820830-project Sep 01 14:10:44.877480 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Id: default Sep 01 14:10:44.877480 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Name: Default Sep 01 14:10:44.877480 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Id: 61401557e7624580b20de6e31c92f785 Sep 01 14:10:44.877480 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1249820830-project Sep 01 14:10:44.877480 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: method: > Sep 01 14:10:44.877480 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: exception: Instance d39f7090-b419-46be-9fcc-7ae73004ab71 could not be found. Sep 01 14:10:44.877480 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: action_args: {'id': 'd39f7090-b419-46be-9fcc-7ae73004ab71'} Sep 01 14:10:44.878982 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:10:44.878982 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:10:44.878982 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:10:44.878982 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:10:44.878982 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:10:44.878982 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:10:44.878982 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:10:44.878982 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:10:44.878982 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:10:44.878982 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:10:44.878982 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d39f7090-b419-46be-9fcc-7ae73004ab71 could not be found. Sep 01 14:10:44.878982 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:10:44.878982 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:10:44.878982 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:10:44.878982 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:10:44.878982 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:10:44.878982 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:10:44.878982 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:10:44.878982 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:10:44.878982 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:10:44.880685 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:10:44.880685 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:10:44.880685 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:10:44.880685 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:10:44.880685 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:10:44.880685 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:10:44.880685 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:10:44.880685 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d39f7090-b419-46be-9fcc-7ae73004ab71 could not be found. Sep 01 14:10:44.880685 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:10:44.880685 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:10:44.880685 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:10:44.880685 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:10:44.880685 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:10:44.880685 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:10:44.880685 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:10:44.880685 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:10:44.880685 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d39f7090-b419-46be-9fcc-7ae73004ab71 could not be found. Sep 01 14:10:44.880685 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:10:44.882077 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-94b46707-b46e-4e08-b84f-5778e5d7f62a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Returning 404 to user: Instance d39f7090-b419-46be-9fcc-7ae73004ab71 could not be found. {{(pid=121339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:10:44.882077 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-94b46707-b46e-4e08-b84f-5778e5d7f62a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 404 len: 111 microversion: 2.20 time: 0.036596 Sep 01 14:10:44.882077 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 286/589] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:10:44 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 14:10:44.896492 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-d3886996-2ef8-460c-ad97-9f21441a5f25 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '.version_select at 0x7f9867946b80>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:44.975557 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-d3886996-2ef8-460c-ad97-9f21441a5f25 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1128071397" status: 204 len: 0 microversion: 2.20 time: 0.083467 Sep 01 14:10:44.976395 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 304/590] 10.222.0.25 () {60 vars in 1262 bytes} [Thu Sep 1 14:10:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1128071397 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 14:10:45.176452 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-0507150a-f864-4f87-8c1b-e9fb9b861710 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:45.178180 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-0507150a-f864-4f87-8c1b-e9fb9b861710 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:45.193275 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0507150a-f864-4f87-8c1b-e9fb9b861710 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:45.194341 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0507150a-f864-4f87-8c1b-e9fb9b861710 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:45.195760 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0507150a-f864-4f87-8c1b-e9fb9b861710 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:45.197031 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0507150a-f864-4f87-8c1b-e9fb9b861710 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:45.198020 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0507150a-f864-4f87-8c1b-e9fb9b861710 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:45.198784 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0507150a-f864-4f87-8c1b-e9fb9b861710 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:45.425701 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-0507150a-f864-4f87-8c1b-e9fb9b861710 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:45.442947 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-0507150a-f864-4f87-8c1b-e9fb9b861710 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1734 microversion: 2.1 time: 0.275691 Sep 01 14:10:45.443545 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 287/591] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:45 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1734 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:46.127447 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-f30d8086-b38f-4ddd-998d-129a27181b3e tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Action: 'create', calling method: .version_select at 0x7f9867968c10>, body: {"keypair": {"name": "tempest-keypair-211649193", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIckLhlHyQL/a/LI24DcPLZAyLl0QISZn6TX2mlopN18xJqbHBKVIjsrjqBpMxJV8Tm3jKCtmt96LkTI3G5srtjCKynYrNdsuvzK1oHYvF+hPuzxWJIjPg2vyLe2fDjNg=="}} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:10:46.147989 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.quota [None req-f30d8086-b38f-4ddd-998d-129a27181b3e tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Getting quotas for project 3ed58deb61194a5ba3f2d46eb7e5680c. Resources: {'key_pairs'} {{(pid=121340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:10:46.152510 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.quota [None req-f30d8086-b38f-4ddd-998d-129a27181b3e tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Getting quotas for user 61401557e7624580b20de6e31c92f785 and project 3ed58deb61194a5ba3f2d46eb7e5680c. Resources: {'key_pairs'} {{(pid=121340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:10:46.250377 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-f30d8086-b38f-4ddd-998d-129a27181b3e tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.128190 Sep 01 14:10:46.251785 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 305/592] 10.222.0.25 () {62 vars in 1200 bytes} [Thu Sep 1 14:10:46 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 130 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 01 14:10:46.480607 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-d9b0fd28-084f-4644-8efc-a11739cce759 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:46.482053 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-d9b0fd28-084f-4644-8efc-a11739cce759 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:46.492866 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d9b0fd28-084f-4644-8efc-a11739cce759 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:46.493398 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d9b0fd28-084f-4644-8efc-a11739cce759 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:46.493850 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d9b0fd28-084f-4644-8efc-a11739cce759 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:46.494619 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d9b0fd28-084f-4644-8efc-a11739cce759 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:46.495080 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d9b0fd28-084f-4644-8efc-a11739cce759 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:46.495512 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d9b0fd28-084f-4644-8efc-a11739cce759 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:46.741370 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-d9b0fd28-084f-4644-8efc-a11739cce759 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:46.751587 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-d9b0fd28-084f-4644-8efc-a11739cce759 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1734 microversion: 2.1 time: 0.278937 Sep 01 14:10:46.752554 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 288/593] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:46 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1734 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:46.806370 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-4cbee253-38ec-442a-ac6e-b02ada234a01 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:46.806903 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-4cbee253-38ec-442a-ac6e-b02ada234a01 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:46.813421 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4cbee253-38ec-442a-ac6e-b02ada234a01 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:46.814125 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4cbee253-38ec-442a-ac6e-b02ada234a01 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:46.814668 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4cbee253-38ec-442a-ac6e-b02ada234a01 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:46.815487 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4cbee253-38ec-442a-ac6e-b02ada234a01 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:46.816290 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4cbee253-38ec-442a-ac6e-b02ada234a01 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:46.817014 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4cbee253-38ec-442a-ac6e-b02ada234a01 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:46.996934 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-4cbee253-38ec-442a-ac6e-b02ada234a01 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:47.007426 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-4cbee253-38ec-442a-ac6e-b02ada234a01 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1595 microversion: 2.1 time: 0.205668 Sep 01 14:10:47.008268 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 306/594] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:46 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1595 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:47.773037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-6b978af9-4eb0-4f49-b66e-6b812a3836fb tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:47.773678 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-6b978af9-4eb0-4f49-b66e-6b812a3836fb tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:47.780599 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6b978af9-4eb0-4f49-b66e-6b812a3836fb tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:47.781090 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6b978af9-4eb0-4f49-b66e-6b812a3836fb tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:47.781526 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6b978af9-4eb0-4f49-b66e-6b812a3836fb tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:47.782321 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6b978af9-4eb0-4f49-b66e-6b812a3836fb tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:47.782778 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6b978af9-4eb0-4f49-b66e-6b812a3836fb tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:47.783309 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6b978af9-4eb0-4f49-b66e-6b812a3836fb tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:48.060991 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-6b978af9-4eb0-4f49-b66e-6b812a3836fb tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:48.083772 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-6b978af9-4eb0-4f49-b66e-6b812a3836fb tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1734 microversion: 2.1 time: 0.314333 Sep 01 14:10:48.084985 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 289/595] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:47 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1734 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:10:49.123131 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-6137ec49-0667-4e5f-a2c1-cf5dba7b811a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:49.124452 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-6137ec49-0667-4e5f-a2c1-cf5dba7b811a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:49.136596 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6137ec49-0667-4e5f-a2c1-cf5dba7b811a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:49.137676 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6137ec49-0667-4e5f-a2c1-cf5dba7b811a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:49.138612 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6137ec49-0667-4e5f-a2c1-cf5dba7b811a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:49.140058 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6137ec49-0667-4e5f-a2c1-cf5dba7b811a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:49.141231 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6137ec49-0667-4e5f-a2c1-cf5dba7b811a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:49.142666 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6137ec49-0667-4e5f-a2c1-cf5dba7b811a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:49.496385 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-5ace46cb-6842-44f3-ac2e-0b0b90efa0e1 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-154279277", "imageRef": "9be77128-e763-4225-b76f-85fbb04ad9b2", "flavorRef": "452", "networks": [{"uuid": "d1c0ee50-5f2f-4508-9ae2-29e7d03abfd0"}]}} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:10:49.519130 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:10:49.538306 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-6137ec49-0667-4e5f-a2c1-cf5dba7b811a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:49.557987 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-6137ec49-0667-4e5f-a2c1-cf5dba7b811a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1734 microversion: 2.1 time: 0.442176 Sep 01 14:10:49.559003 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 307/596] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:49 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1734 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:49.633483 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.network.neutron [None req-5ace46cb-6842-44f3-ac2e-0b0b90efa0e1 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] validate_networks() for [('d1c0ee50-5f2f-4508-9ae2-29e7d03abfd0', None, None, None, None, None)] {{(pid=121339) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:10:49.692406 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-d39e0537-b80a-4a12-807e-ab42a01df575 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-569102892", "imageRef": "9be77128-e763-4225-b76f-85fbb04ad9b2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "04671c53-ca48-4ca5-8247-463b6ac1fbe1"}], "security_groups": [{"name": "tempest-securitygroup--1215927888"}], "key_name": "tempest-keypair-211649193", "user_data": "}} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:10:50.192606 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.network.neutron [None req-d39e0537-b80a-4a12-807e-ab42a01df575 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] validate_networks() for [('04671c53-ca48-4ca5-8247-463b6ac1fbe1', None, None, None, None, None)] {{(pid=121340) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:10:50.690797 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.virt.hardware [None req-5ace46cb-6842-44f3-ac2e-0b0b90efa0e1 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Flavor limits 0:0:0 {{(pid=121339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:10:50.691643 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.virt.hardware [None req-5ace46cb-6842-44f3-ac2e-0b0b90efa0e1 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Image limits 0:0:0 {{(pid=121339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:10:50.692513 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.virt.hardware [None req-5ace46cb-6842-44f3-ac2e-0b0b90efa0e1 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Flavor pref 0:0:0 {{(pid=121339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:10:50.693173 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.virt.hardware [None req-5ace46cb-6842-44f3-ac2e-0b0b90efa0e1 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Image pref 0:0:0 {{(pid=121339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:10:50.693759 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.virt.hardware [None req-5ace46cb-6842-44f3-ac2e-0b0b90efa0e1 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:10:50.712337 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5ace46cb-6842-44f3-ac2e-0b0b90efa0e1 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:50.713377 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5ace46cb-6842-44f3-ac2e-0b0b90efa0e1 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:50.714784 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5ace46cb-6842-44f3-ac2e-0b0b90efa0e1 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:50.715690 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5ace46cb-6842-44f3-ac2e-0b0b90efa0e1 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:50.716498 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5ace46cb-6842-44f3-ac2e-0b0b90efa0e1 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:50.717223 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5ace46cb-6842-44f3-ac2e-0b0b90efa0e1 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:50.753218 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.quota [None req-5ace46cb-6842-44f3-ac2e-0b0b90efa0e1 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Getting quotas for project 2e6d998735c243c3bcd08ca2e2d81ae9. Resources: {'cores', 'instances', 'ram'} {{(pid=121339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:10:50.762027 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.quota [None req-5ace46cb-6842-44f3-ac2e-0b0b90efa0e1 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Getting quotas for user e53d275b44a2432a9fe8611304bcfa91 and project 2e6d998735c243c3bcd08ca2e2d81ae9. Resources: {'cores', 'instances', 'ram'} {{(pid=121339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:10:50.789525 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-5ace46cb-6842-44f3-ac2e-0b0b90efa0e1 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Going to run 1 instances... {{(pid=121339) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:10:50.794479 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-5ace46cb-6842-44f3-ac2e-0b0b90efa0e1 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 929d6445-681f-48b3-b51f-495532864e64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9be77128-e763-4225-b76f-85fbb04ad9b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:10:50.959583 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-5ace46cb-6842-44f3-ac2e-0b0b90efa0e1 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.469942 Sep 01 14:10:50.961442 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 290/597] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 1 14:10:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1474 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 14:10:50.967612 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-dbd7cad3-193c-4c96-b469-20ce86dd619d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:50.968984 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-dbd7cad3-193c-4c96-b469-20ce86dd619d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:50.978528 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-dbd7cad3-193c-4c96-b469-20ce86dd619d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:50.979699 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-dbd7cad3-193c-4c96-b469-20ce86dd619d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:50.980899 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-dbd7cad3-193c-4c96-b469-20ce86dd619d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:50.982643 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-dbd7cad3-193c-4c96-b469-20ce86dd619d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:50.983854 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-dbd7cad3-193c-4c96-b469-20ce86dd619d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:50.984614 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-dbd7cad3-193c-4c96-b469-20ce86dd619d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:51.119824 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-d39e0537-b80a-4a12-807e-ab42a01df575 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Flavor limits 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:10:51.120851 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-d39e0537-b80a-4a12-807e-ab42a01df575 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Image limits 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:10:51.122196 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-d39e0537-b80a-4a12-807e-ab42a01df575 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Flavor pref 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:10:51.123061 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-d39e0537-b80a-4a12-807e-ab42a01df575 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Image pref 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:10:51.123903 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-d39e0537-b80a-4a12-807e-ab42a01df575 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:10:51.171332 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d39e0537-b80a-4a12-807e-ab42a01df575 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:51.175436 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d39e0537-b80a-4a12-807e-ab42a01df575 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:51.178352 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d39e0537-b80a-4a12-807e-ab42a01df575 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:51.183544 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d39e0537-b80a-4a12-807e-ab42a01df575 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:51.184821 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d39e0537-b80a-4a12-807e-ab42a01df575 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:51.187932 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d39e0537-b80a-4a12-807e-ab42a01df575 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:51.207714 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-dbd7cad3-193c-4c96-b469-20ce86dd619d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:51.226999 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-dbd7cad3-193c-4c96-b469-20ce86dd619d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1734 microversion: 2.1 time: 0.260462 Sep 01 14:10:51.230081 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 291/598] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:50 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1734 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:51.237659 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [req-f37e1fc2-a00e-411a-90ab-07731277aace req-9dd39d80-6daa-4c8e-b036-d9f90117b638 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d917f141-65db-49b0-87ed-0e1e0b72bb4a", "tag": "9784e98b-3dcc-42d6-a82e-41f46d73700f"}]} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:10:51.240358 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.quota [None req-d39e0537-b80a-4a12-807e-ab42a01df575 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Getting quotas for project 3ed58deb61194a5ba3f2d46eb7e5680c. Resources: {'cores', 'instances', 'ram'} {{(pid=121340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:10:51.250212 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.quota [None req-d39e0537-b80a-4a12-807e-ab42a01df575 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Getting quotas for user 61401557e7624580b20de6e31c92f785 and project 3ed58deb61194a5ba3f2d46eb7e5680c. Resources: {'cores', 'instances', 'ram'} {{(pid=121340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:10:51.271301 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-f37e1fc2-a00e-411a-90ab-07731277aace req-9dd39d80-6daa-4c8e-b036-d9f90117b638 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:51.272421 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-f37e1fc2-a00e-411a-90ab-07731277aace req-9dd39d80-6daa-4c8e-b036-d9f90117b638 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:51.273579 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-f37e1fc2-a00e-411a-90ab-07731277aace req-9dd39d80-6daa-4c8e-b036-d9f90117b638 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:51.276034 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-d39e0537-b80a-4a12-807e-ab42a01df575 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Going to run 1 instances... {{(pid=121340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:10:51.284127 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-d39e0537-b80a-4a12-807e-ab42a01df575 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9be77128-e763-4225-b76f-85fbb04ad9b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:10:51.297369 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.compute.server_external_events [req-f37e1fc2-a00e-411a-90ab-07731277aace req-9dd39d80-6daa-4c8e-b036-d9f90117b638 service nova] Creating event network-changed:9784e98b-3dcc-42d6-a82e-41f46d73700f for instance d917f141-65db-49b0-87ed-0e1e0b72bb4a on hv-cinder-85221 Sep 01 14:10:51.307567 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [req-f37e1fc2-a00e-411a-90ab-07731277aace req-9dd39d80-6daa-4c8e-b036-d9f90117b638 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074138 Sep 01 14:10:51.310254 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 292/599] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:10:51.323727 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-730c5f93-71ee-4c65-b1d6-3ba1f8915cf7 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:51.325627 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-730c5f93-71ee-4c65-b1d6-3ba1f8915cf7 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 929d6445-681f-48b3-b51f-495532864e64] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:51.505289 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-730c5f93-71ee-4c65-b1d6-3ba1f8915cf7 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53d275b44a2432a9fe8611304bcfa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d998735c243c3bcd08ca2e2d81ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:51.522250 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-d39e0537-b80a-4a12-807e-ab42a01df575 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.825726 Sep 01 14:10:51.522250 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 308/600] 10.222.0.25 () {62 vars in 1188 bytes} [Thu Sep 1 14:10:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 1828 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 01 14:10:51.535057 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-730c5f93-71ee-4c65-b1d6-3ba1f8915cf7 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "GET /compute/v2.1/servers/929d6445-681f-48b3-b51f-495532864e64" status: 200 len: 1218 microversion: 2.1 time: 0.222107 Sep 01 14:10:51.536939 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-8fabaef3-fde1-48c0-8f9b-fd8b9e1cde8c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:51.548669 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-8fabaef3-fde1-48c0-8f9b-fd8b9e1cde8c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:51.555982 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 293/601] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:51 2022] GET /compute/v2.1/servers/929d6445-681f-48b3-b51f-495532864e64 => generated 1218 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:51.765078 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-8fabaef3-fde1-48c0-8f9b-fd8b9e1cde8c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:51.788620 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-8fabaef3-fde1-48c0-8f9b-fd8b9e1cde8c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:51.792403 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-8fabaef3-fde1-48c0-8f9b-fd8b9e1cde8c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:51.795100 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-8fabaef3-fde1-48c0-8f9b-fd8b9e1cde8c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1280 microversion: 2.20 time: 0.267261 Sep 01 14:10:51.797044 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 309/602] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:10:51 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1280 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:10:51.922815 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-27e47b14-d252-4899-93f2-6b9e950beaa1 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:51.924168 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-27e47b14-d252-4899-93f2-6b9e950beaa1 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 3e82006c-11f2-43d8-b929-e161f9c506d4] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:51.931841 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-27e47b14-d252-4899-93f2-6b9e950beaa1 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:51.933003 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-27e47b14-d252-4899-93f2-6b9e950beaa1 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:51.933680 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-27e47b14-d252-4899-93f2-6b9e950beaa1 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:51.934854 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-27e47b14-d252-4899-93f2-6b9e950beaa1 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:51.935549 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-27e47b14-d252-4899-93f2-6b9e950beaa1 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:51.936193 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-27e47b14-d252-4899-93f2-6b9e950beaa1 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:51.968427 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-27e47b14-d252-4899-93f2-6b9e950beaa1 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4/ips" status: 200 len: 149 microversion: 2.1 time: 0.050014 Sep 01 14:10:51.969024 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 294/603] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Sep 1 14:10:51 2022] GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4/ips => generated 149 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:10:51.989697 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-67a79740-7a43-4d8b-b32b-2ec0ae191054 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c504c147-522f-4221-acc3-2090374b1b08"}} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:10:51.993780 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-67a79740-7a43-4d8b-b32b-2ec0ae191054 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 3e82006c-11f2-43d8-b929-e161f9c506d4] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:52.008227 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-67a79740-7a43-4d8b-b32b-2ec0ae191054 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:52.008619 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-67a79740-7a43-4d8b-b32b-2ec0ae191054 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:52.009060 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-67a79740-7a43-4d8b-b32b-2ec0ae191054 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:52.009790 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-67a79740-7a43-4d8b-b32b-2ec0ae191054 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:52.010312 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-67a79740-7a43-4d8b-b32b-2ec0ae191054 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:52.010834 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-67a79740-7a43-4d8b-b32b-2ec0ae191054 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:52.039364 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:10:52.194617 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.wsgi [None req-67a79740-7a43-4d8b-b32b-2ec0ae191054 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] HTTP exception thrown: Invalid volume: volume c504c147-522f-4221-acc3-2090374b1b08 is already attached to instances: 91814986-adf4-46cb-8edf-820106d37ecb Sep 01 14:10:52.199385 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-67a79740-7a43-4d8b-b32b-2ec0ae191054 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Request method failure captured: Sep 01 14:10:52.199385 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: request: POST /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4/os-volume_attachments HTTP/1.1 Sep 01 14:10:52.199385 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept: application/json Sep 01 14:10:52.199385 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept-Encoding: identity Sep 01 14:10:52.199385 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Connection: close Sep 01 14:10:52.199385 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Length: 74 Sep 01 14:10:52.199385 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Type: application/json Sep 01 14:10:52.199385 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Host: 10.222.0.25 Sep 01 14:10:52.199385 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Openstack-System-Scope: None Sep 01 14:10:52.199385 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: User-Agent: python-urllib3/1.26.12 Sep 01 14:10:52.199385 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Auth-Token: gAAAAABjELyhZj5Hr9I4grX9g-sLmSzxOFwV6C8_UuPsJu0TTboeG4lPJ1EtlgmTO6Q18ohdm_zKgQxmrLRlDi5SpU-ZjSVzLIRa5u6LBsCTR0TutJimllLkII0Ts1UxHVT4475s7UI-5uK5aNVzYOSUMxaGRq9ZaCGPwi2wkROzwm6JUQLDfLI Sep 01 14:10:52.199385 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Id: None Sep 01 14:10:52.199385 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Name: None Sep 01 14:10:52.199385 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Identity-Status: Confirmed Sep 01 14:10:52.199385 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Is-Admin-Project: True Sep 01 14:10:52.199385 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Id: default Sep 01 14:10:52.199385 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Name: Default Sep 01 14:10:52.199385 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Id: 90a84500a899479aabfa3aeb72b4c4ae Sep 01 14:10:52.199385 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Name: tempest-AttachVolumeNegativeTest-836381067 Sep 01 14:10:52.199385 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Role: member,reader Sep 01 14:10:52.199385 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Roles: member,reader Sep 01 14:10:52.200979 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/90a84500a899479aabfa3aeb72b4c4ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/90a84500a899479aabfa3aeb72b4c4ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/90a84500a899479aabfa3aeb72b4c4ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_90a84500a899479aabfa3aeb72b4c4ae"}]}] Sep 01 14:10:52.200979 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant: tempest-AttachVolumeNegativeTest-836381067 Sep 01 14:10:52.200979 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Id: 90a84500a899479aabfa3aeb72b4c4ae Sep 01 14:10:52.200979 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-836381067 Sep 01 14:10:52.200979 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User: tempest-AttachVolumeNegativeTest-836381067-project Sep 01 14:10:52.200979 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Id: default Sep 01 14:10:52.200979 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Name: Default Sep 01 14:10:52.200979 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Id: 7ae66df61a764a42a1b1b15f54d5c34b Sep 01 14:10:52.200979 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Name: tempest-AttachVolumeNegativeTest-836381067-project Sep 01 14:10:52.200979 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Sep 01 14:10:52.200979 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: {"volumeAttachment": {"volumeId": "c504c147-522f-4221-acc3-2090374b1b08"}} Sep 01 14:10:52.200979 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: method: > Sep 01 14:10:52.201847 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: exception: Invalid volume: volume c504c147-522f-4221-acc3-2090374b1b08 is already attached to instances: 91814986-adf4-46cb-8edf-820106d37ecb Sep 01 14:10:52.201847 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: action_args: {'server_id': '3e82006c-11f2-43d8-b929-e161f9c506d4', 'body': {'volumeAttachment': {'volumeId': 'c504c147-522f-4221-acc3-2090374b1b08'}}} Sep 01 14:10:52.201847 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:10:52.201847 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:10:52.201847 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 14:10:52.201847 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 14:10:52.201847 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 14:10:52.201847 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 14:10:52.201847 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 01 14:10:52.201847 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 14:10:52.201847 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 01 14:10:52.201847 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 01 14:10:52.201847 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 01 14:10:52.201847 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 01 14:10:52.201847 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c504c147-522f-4221-acc3-2090374b1b08 is already attached to instances: 91814986-adf4-46cb-8edf-820106d37ecb Sep 01 14:10:52.201847 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:10:52.201847 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:10:52.201847 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:10:52.201847 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:10:52.203493 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:10:52.203493 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:10:52.203493 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:10:52.203493 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:10:52.203493 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:10:52.203493 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:10:52.203493 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 14:10:52.203493 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 14:10:52.203493 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 14:10:52.203493 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 14:10:52.203493 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 14:10:52.203493 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 14:10:52.203493 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 01 14:10:52.203493 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 01 14:10:52.203493 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c504c147-522f-4221-acc3-2090374b1b08 is already attached to instances: 91814986-adf4-46cb-8edf-820106d37ecb Sep 01 14:10:52.203493 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:10:52.203493 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:10:52.203493 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:10:52.203493 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:10:52.203493 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:10:52.205619 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:10:52.205619 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:10:52.205619 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:10:52.205619 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c504c147-522f-4221-acc3-2090374b1b08 is already attached to instances: 91814986-adf4-46cb-8edf-820106d37ecb Sep 01 14:10:52.205619 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:10:52.205619 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-67a79740-7a43-4d8b-b32b-2ec0ae191054 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Returning 400 to user: Invalid volume: volume c504c147-522f-4221-acc3-2090374b1b08 is already attached to instances: 91814986-adf4-46cb-8edf-820106d37ecb {{(pid=121340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:10:52.205619 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-67a79740-7a43-4d8b-b32b-2ec0ae191054 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "POST /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.219495 Sep 01 14:10:52.205619 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 310/604] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Sep 1 14:10:51 2022] POST /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4/os-volume_attachments => generated 174 bytes in 221 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 14:10:52.227932 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-62c60798-0d16-4736-b7d5-a387dce88a7f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:52.229001 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-62c60798-0d16-4736-b7d5-a387dce88a7f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 3e82006c-11f2-43d8-b929-e161f9c506d4] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:52.240705 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-62c60798-0d16-4736-b7d5-a387dce88a7f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:52.241601 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-62c60798-0d16-4736-b7d5-a387dce88a7f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:52.242402 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-62c60798-0d16-4736-b7d5-a387dce88a7f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:52.244238 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-62c60798-0d16-4736-b7d5-a387dce88a7f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:52.246978 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-62c60798-0d16-4736-b7d5-a387dce88a7f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:52.248382 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-62c60798-0d16-4736-b7d5-a387dce88a7f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:52.249355 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-f9566dd4-e3f9-436c-9241-2cf20ae512d8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:52.250217 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-f9566dd4-e3f9-436c-9241-2cf20ae512d8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:52.261310 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f9566dd4-e3f9-436c-9241-2cf20ae512d8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:52.261541 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f9566dd4-e3f9-436c-9241-2cf20ae512d8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:52.262333 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f9566dd4-e3f9-436c-9241-2cf20ae512d8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:52.281117 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f9566dd4-e3f9-436c-9241-2cf20ae512d8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:52.281117 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f9566dd4-e3f9-436c-9241-2cf20ae512d8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:52.281117 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f9566dd4-e3f9-436c-9241-2cf20ae512d8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:52.316451 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-62c60798-0d16-4736-b7d5-a387dce88a7f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 3e82006c-11f2-43d8-b929-e161f9c506d4] Going to try to terminate instance {{(pid=121339) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:10:52.559269 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-f9566dd4-e3f9-436c-9241-2cf20ae512d8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:52.575341 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-f9566dd4-e3f9-436c-9241-2cf20ae512d8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1734 microversion: 2.1 time: 0.328159 Sep 01 14:10:52.576261 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 311/605] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:52 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1734 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:52.586378 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-52ca2fc7-6eeb-47de-813f-34880c2c2512 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:52.587574 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-52ca2fc7-6eeb-47de-813f-34880c2c2512 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 929d6445-681f-48b3-b51f-495532864e64] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:52.656807 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-52ca2fc7-6eeb-47de-813f-34880c2c2512 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53d275b44a2432a9fe8611304bcfa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d998735c243c3bcd08ca2e2d81ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:52.686428 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-52ca2fc7-6eeb-47de-813f-34880c2c2512 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "GET /compute/v2.1/servers/929d6445-681f-48b3-b51f-495532864e64" status: 200 len: 1218 microversion: 2.1 time: 0.108434 Sep 01 14:10:52.687418 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 312/606] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:52 2022] GET /compute/v2.1/servers/929d6445-681f-48b3-b51f-495532864e64 => generated 1218 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:52.841668 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-1b95fe6f-00e8-4826-aa92-d60eff941df5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:52.843001 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-1b95fe6f-00e8-4826-aa92-d60eff941df5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:52.921634 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-62c60798-0d16-4736-b7d5-a387dce88a7f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4" status: 204 len: 0 microversion: 2.1 time: 0.704323 Sep 01 14:10:52.921634 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 295/607] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 14:10:52 2022] DELETE /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4 => generated 0 bytes in 708 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:10:52.927915 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-1b95fe6f-00e8-4826-aa92-d60eff941df5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:52.933263 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-f698250d-84df-4e5f-bbdb-0b2cd9be8554 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:52.934518 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-f698250d-84df-4e5f-bbdb-0b2cd9be8554 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 3e82006c-11f2-43d8-b929-e161f9c506d4] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:52.943587 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-1b95fe6f-00e8-4826-aa92-d60eff941df5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:52.949611 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f698250d-84df-4e5f-bbdb-0b2cd9be8554 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:52.950064 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-1b95fe6f-00e8-4826-aa92-d60eff941df5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:52.950263 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f698250d-84df-4e5f-bbdb-0b2cd9be8554 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:52.950263 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f698250d-84df-4e5f-bbdb-0b2cd9be8554 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:52.950263 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f698250d-84df-4e5f-bbdb-0b2cd9be8554 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:52.950686 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-1b95fe6f-00e8-4826-aa92-d60eff941df5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1280 microversion: 2.20 time: 0.112538 Sep 01 14:10:52.950823 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f698250d-84df-4e5f-bbdb-0b2cd9be8554 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:52.950956 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 313/608] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:10:52 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1280 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:10:52.951151 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f698250d-84df-4e5f-bbdb-0b2cd9be8554 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:53.132741 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-f698250d-84df-4e5f-bbdb-0b2cd9be8554 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:53.143686 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-f698250d-84df-4e5f-bbdb-0b2cd9be8554 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4" status: 200 len: 1680 microversion: 2.1 time: 0.217568 Sep 01 14:10:53.144841 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 296/609] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:52 2022] GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4 => generated 1680 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:53.612486 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-627bec81-e64a-4850-af16-dca27603825d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:53.613509 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-627bec81-e64a-4850-af16-dca27603825d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:53.623844 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-627bec81-e64a-4850-af16-dca27603825d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:53.624595 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-627bec81-e64a-4850-af16-dca27603825d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:53.625148 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-627bec81-e64a-4850-af16-dca27603825d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:53.627232 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-627bec81-e64a-4850-af16-dca27603825d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:53.627874 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-627bec81-e64a-4850-af16-dca27603825d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:53.628413 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-627bec81-e64a-4850-af16-dca27603825d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:53.716115 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-596f436a-e6a6-4c0b-807b-7834bb449858 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:53.716933 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-596f436a-e6a6-4c0b-807b-7834bb449858 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 929d6445-681f-48b3-b51f-495532864e64] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:53.726532 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-596f436a-e6a6-4c0b-807b-7834bb449858 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:53.727252 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-596f436a-e6a6-4c0b-807b-7834bb449858 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:53.727920 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-596f436a-e6a6-4c0b-807b-7834bb449858 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:53.728900 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-596f436a-e6a6-4c0b-807b-7834bb449858 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:53.729705 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-596f436a-e6a6-4c0b-807b-7834bb449858 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:53.730280 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-596f436a-e6a6-4c0b-807b-7834bb449858 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:53.737232 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:10:53.819113 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-596f436a-e6a6-4c0b-807b-7834bb449858 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53d275b44a2432a9fe8611304bcfa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d998735c243c3bcd08ca2e2d81ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:53.830560 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-596f436a-e6a6-4c0b-807b-7834bb449858 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "GET /compute/v2.1/servers/929d6445-681f-48b3-b51f-495532864e64" status: 200 len: 1222 microversion: 2.1 time: 0.119081 Sep 01 14:10:53.831280 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 297/610] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:53 2022] GET /compute/v2.1/servers/929d6445-681f-48b3-b51f-495532864e64 => generated 1222 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:53.847209 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-627bec81-e64a-4850-af16-dca27603825d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:53.863697 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-627bec81-e64a-4850-af16-dca27603825d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1734 microversion: 2.1 time: 0.256417 Sep 01 14:10:53.865026 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 314/611] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:53 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1734 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:53.977099 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-21f99646-aaee-4e71-9677-251ca4e44537 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:53.978233 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-21f99646-aaee-4e71-9677-251ca4e44537 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:53.989519 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-21f99646-aaee-4e71-9677-251ca4e44537 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:53.990360 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-21f99646-aaee-4e71-9677-251ca4e44537 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:53.991077 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-21f99646-aaee-4e71-9677-251ca4e44537 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:53.992272 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-21f99646-aaee-4e71-9677-251ca4e44537 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:53.993054 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-21f99646-aaee-4e71-9677-251ca4e44537 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:53.993793 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-21f99646-aaee-4e71-9677-251ca4e44537 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:54.088614 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-21f99646-aaee-4e71-9677-251ca4e44537 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:54.098532 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-21f99646-aaee-4e71-9677-251ca4e44537 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:54.100885 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-21f99646-aaee-4e71-9677-251ca4e44537 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:54.102177 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-21f99646-aaee-4e71-9677-251ca4e44537 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1284 microversion: 2.20 time: 0.133014 Sep 01 14:10:54.103301 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 298/612] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:10:53 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1284 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:10:54.181230 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-9c17bc2e-3777-4cee-b737-086c00b55452 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:54.181840 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-9c17bc2e-3777-4cee-b737-086c00b55452 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 3e82006c-11f2-43d8-b929-e161f9c506d4] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:54.188217 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9c17bc2e-3777-4cee-b737-086c00b55452 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:54.189517 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9c17bc2e-3777-4cee-b737-086c00b55452 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:54.189992 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9c17bc2e-3777-4cee-b737-086c00b55452 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:54.190718 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9c17bc2e-3777-4cee-b737-086c00b55452 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:54.191187 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9c17bc2e-3777-4cee-b737-086c00b55452 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:54.191607 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9c17bc2e-3777-4cee-b737-086c00b55452 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:54.414052 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-9c17bc2e-3777-4cee-b737-086c00b55452 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:54.418181 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-9c17bc2e-3777-4cee-b737-086c00b55452 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4" status: 200 len: 1680 microversion: 2.1 time: 0.240818 Sep 01 14:10:54.418492 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-64d4eb11-9fc8-438f-9b36-ce9dfa78e3e8 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2009233229"}} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:10:54.434011 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-64d4eb11-9fc8-438f-9b36-ce9dfa78e3e8 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:54.434311 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 315/613] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:54 2022] GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4 => generated 1680 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:10:54.434661 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-64d4eb11-9fc8-438f-9b36-ce9dfa78e3e8 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:54.434661 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-64d4eb11-9fc8-438f-9b36-ce9dfa78e3e8 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:54.434661 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-64d4eb11-9fc8-438f-9b36-ce9dfa78e3e8 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:54.434661 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-64d4eb11-9fc8-438f-9b36-ce9dfa78e3e8 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:54.435335 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-64d4eb11-9fc8-438f-9b36-ce9dfa78e3e8 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:54.435335 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-64d4eb11-9fc8-438f-9b36-ce9dfa78e3e8 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:54.615554 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.network.security_group_api [None req-64d4eb11-9fc8-438f-9b36-ce9dfa78e3e8 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Adding security group 28137255-a9b5-42bf-804b-d3e5db5441a5 to port 9784e98b-3dcc-42d6-a82e-41f46d73700f Sep 01 14:10:54.859173 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-62ebb482-1803-4174-bcc3-b1378325366b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:54.860980 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-62ebb482-1803-4174-bcc3-b1378325366b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 929d6445-681f-48b3-b51f-495532864e64] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:54.873633 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-62ebb482-1803-4174-bcc3-b1378325366b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:54.874398 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-62ebb482-1803-4174-bcc3-b1378325366b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:54.886463 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-62ebb482-1803-4174-bcc3-b1378325366b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:54.887568 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-62ebb482-1803-4174-bcc3-b1378325366b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:54.888220 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-62ebb482-1803-4174-bcc3-b1378325366b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:54.898973 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-62ebb482-1803-4174-bcc3-b1378325366b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:55.069058 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-62ebb482-1803-4174-bcc3-b1378325366b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53d275b44a2432a9fe8611304bcfa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d998735c243c3bcd08ca2e2d81ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:55.098504 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-62ebb482-1803-4174-bcc3-b1378325366b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "GET /compute/v2.1/servers/929d6445-681f-48b3-b51f-495532864e64" status: 200 len: 1214 microversion: 2.1 time: 0.230270 Sep 01 14:10:55.098504 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 316/614] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:54 2022] GET /compute/v2.1/servers/929d6445-681f-48b3-b51f-495532864e64 => generated 1214 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:10:55.105327 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-f43b6a17-e053-42a0-a08a-d51e7507f876 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:55.106066 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-f43b6a17-e053-42a0-a08a-d51e7507f876 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:55.115453 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f43b6a17-e053-42a0-a08a-d51e7507f876 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:55.115968 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f43b6a17-e053-42a0-a08a-d51e7507f876 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:55.116466 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f43b6a17-e053-42a0-a08a-d51e7507f876 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:55.117208 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f43b6a17-e053-42a0-a08a-d51e7507f876 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:55.117670 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f43b6a17-e053-42a0-a08a-d51e7507f876 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:55.118126 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f43b6a17-e053-42a0-a08a-d51e7507f876 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:55.679202 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-64d4eb11-9fc8-438f-9b36-ce9dfa78e3e8 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "POST /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a/action" status: 202 len: 0 microversion: 2.1 time: 1.267962 Sep 01 14:10:55.680491 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 299/615] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Sep 1 14:10:54 2022] POST /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a/action => generated 0 bytes in 1271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:10:55.691244 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-a69c1928-900e-4ba0-b57d-4ccb8b91b747 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:55.696322 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-a69c1928-900e-4ba0-b57d-4ccb8b91b747 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:55.705604 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a69c1928-900e-4ba0-b57d-4ccb8b91b747 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:55.706957 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a69c1928-900e-4ba0-b57d-4ccb8b91b747 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:55.708675 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a69c1928-900e-4ba0-b57d-4ccb8b91b747 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:55.710775 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a69c1928-900e-4ba0-b57d-4ccb8b91b747 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:55.712444 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a69c1928-900e-4ba0-b57d-4ccb8b91b747 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:55.713720 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a69c1928-900e-4ba0-b57d-4ccb8b91b747 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:55.808997 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-f43b6a17-e053-42a0-a08a-d51e7507f876 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:55.825864 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-f43b6a17-e053-42a0-a08a-d51e7507f876 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1734 microversion: 2.1 time: 0.724271 Sep 01 14:10:55.827144 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 317/616] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:55 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1734 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:55.836996 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-e9bd03ce-039a-458e-abfc-3791bd4a56c2 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:55.838178 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-e9bd03ce-039a-458e-abfc-3791bd4a56c2 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 3e82006c-11f2-43d8-b929-e161f9c506d4] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:55.849536 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e9bd03ce-039a-458e-abfc-3791bd4a56c2 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:55.850823 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e9bd03ce-039a-458e-abfc-3791bd4a56c2 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:55.851845 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e9bd03ce-039a-458e-abfc-3791bd4a56c2 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:55.853388 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e9bd03ce-039a-458e-abfc-3791bd4a56c2 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:55.854583 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e9bd03ce-039a-458e-abfc-3791bd4a56c2 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:55.855339 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e9bd03ce-039a-458e-abfc-3791bd4a56c2 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:55.914829 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-a69c1928-900e-4ba0-b57d-4ccb8b91b747 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:55.926436 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-a69c1928-900e-4ba0-b57d-4ccb8b91b747 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:55.928418 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-a69c1928-900e-4ba0-b57d-4ccb8b91b747 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:55.930435 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-a69c1928-900e-4ba0-b57d-4ccb8b91b747 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1332 microversion: 2.20 time: 0.247873 Sep 01 14:10:55.931396 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 300/617] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:10:55 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1332 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:10:55.979899 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-93a840d6-cd7e-4206-8d3a-ecb24bedcc76 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:55.981323 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-93a840d6-cd7e-4206-8d3a-ecb24bedcc76 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:55.993686 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-93a840d6-cd7e-4206-8d3a-ecb24bedcc76 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:55.994506 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-93a840d6-cd7e-4206-8d3a-ecb24bedcc76 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:56.003210 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-93a840d6-cd7e-4206-8d3a-ecb24bedcc76 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:56.004261 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-93a840d6-cd7e-4206-8d3a-ecb24bedcc76 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:56.004990 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-93a840d6-cd7e-4206-8d3a-ecb24bedcc76 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:56.005864 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-93a840d6-cd7e-4206-8d3a-ecb24bedcc76 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:56.289561 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-e9bd03ce-039a-458e-abfc-3791bd4a56c2 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:56.340184 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-e9bd03ce-039a-458e-abfc-3791bd4a56c2 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4" status: 200 len: 1680 microversion: 2.1 time: 0.502228 Sep 01 14:10:56.342701 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 318/618] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:55 2022] GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4 => generated 1680 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:56.360132 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [req-53560b66-7da3-4363-9ba5-7363add004da req-e656b73c-3ccd-41bd-89c3-1f5b1ea49b5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d917f141-65db-49b0-87ed-0e1e0b72bb4a", "tag": "9784e98b-3dcc-42d6-a82e-41f46d73700f"}]} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:10:56.391311 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-53560b66-7da3-4363-9ba5-7363add004da req-e656b73c-3ccd-41bd-89c3-1f5b1ea49b5b service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:56.396136 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-53560b66-7da3-4363-9ba5-7363add004da req-e656b73c-3ccd-41bd-89c3-1f5b1ea49b5b service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:56.403152 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-93a840d6-cd7e-4206-8d3a-ecb24bedcc76 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:56.412827 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-53560b66-7da3-4363-9ba5-7363add004da req-e656b73c-3ccd-41bd-89c3-1f5b1ea49b5b service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:56.447826 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-93a840d6-cd7e-4206-8d3a-ecb24bedcc76 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1761 microversion: 2.1 time: 0.497763 Sep 01 14:10:56.451259 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 301/619] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:55 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1761 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:56.469915 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.compute.server_external_events [req-53560b66-7da3-4363-9ba5-7363add004da req-e656b73c-3ccd-41bd-89c3-1f5b1ea49b5b service nova] Creating event network-changed:9784e98b-3dcc-42d6-a82e-41f46d73700f for instance d917f141-65db-49b0-87ed-0e1e0b72bb4a on hv-cinder-85221 Sep 01 14:10:56.477479 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-c8645ae2-fe60-47a9-bb6b-f9a6c68515a7 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:56.480622 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-c8645ae2-fe60-47a9-bb6b-f9a6c68515a7 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 929d6445-681f-48b3-b51f-495532864e64] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:56.497549 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c8645ae2-fe60-47a9-bb6b-f9a6c68515a7 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:56.498354 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c8645ae2-fe60-47a9-bb6b-f9a6c68515a7 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:56.499202 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c8645ae2-fe60-47a9-bb6b-f9a6c68515a7 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:56.501715 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c8645ae2-fe60-47a9-bb6b-f9a6c68515a7 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:56.503345 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c8645ae2-fe60-47a9-bb6b-f9a6c68515a7 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:56.503975 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [req-53560b66-7da3-4363-9ba5-7363add004da req-e656b73c-3ccd-41bd-89c3-1f5b1ea49b5b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147057 Sep 01 14:10:56.504801 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c8645ae2-fe60-47a9-bb6b-f9a6c68515a7 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:56.508364 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 319/620] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:10:56.695745 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-c8645ae2-fe60-47a9-bb6b-f9a6c68515a7 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53d275b44a2432a9fe8611304bcfa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d998735c243c3bcd08ca2e2d81ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:56.709684 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-c8645ae2-fe60-47a9-bb6b-f9a6c68515a7 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "GET /compute/v2.1/servers/929d6445-681f-48b3-b51f-495532864e64" status: 200 len: 1278 microversion: 2.1 time: 0.256318 Sep 01 14:10:56.710678 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 302/621] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:56 2022] GET /compute/v2.1/servers/929d6445-681f-48b3-b51f-495532864e64 => generated 1278 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:56.863873 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-766c003a-21d6-4cb7-8307-1edc38fdd14c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:56.864954 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-766c003a-21d6-4cb7-8307-1edc38fdd14c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:56.908069 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-766c003a-21d6-4cb7-8307-1edc38fdd14c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:56.911045 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-766c003a-21d6-4cb7-8307-1edc38fdd14c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.036s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:56.913796 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-766c003a-21d6-4cb7-8307-1edc38fdd14c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:56.917847 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-766c003a-21d6-4cb7-8307-1edc38fdd14c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:56.920469 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-766c003a-21d6-4cb7-8307-1edc38fdd14c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:56.920934 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-766c003a-21d6-4cb7-8307-1edc38fdd14c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:56.968070 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-06bf30b1-1783-4804-b61a-9cef9c5bb835 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:56.970473 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-06bf30b1-1783-4804-b61a-9cef9c5bb835 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:56.985054 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-06bf30b1-1783-4804-b61a-9cef9c5bb835 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:56.985971 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-06bf30b1-1783-4804-b61a-9cef9c5bb835 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:56.988120 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-06bf30b1-1783-4804-b61a-9cef9c5bb835 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:56.989253 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-06bf30b1-1783-4804-b61a-9cef9c5bb835 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:56.990579 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-06bf30b1-1783-4804-b61a-9cef9c5bb835 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:56.991238 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-06bf30b1-1783-4804-b61a-9cef9c5bb835 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:57.554671 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-06bf30b1-1783-4804-b61a-9cef9c5bb835 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:57.564844 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-06bf30b1-1783-4804-b61a-9cef9c5bb835 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:57.566565 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-06bf30b1-1783-4804-b61a-9cef9c5bb835 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:57.568384 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-06bf30b1-1783-4804-b61a-9cef9c5bb835 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1340 microversion: 2.20 time: 0.604774 Sep 01 14:10:57.583181 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 303/622] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:10:56 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1340 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:10:57.591263 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-4cc72d74-6a58-4b3f-a04b-4534ac24e318 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:57.592047 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-4cc72d74-6a58-4b3f-a04b-4534ac24e318 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 3e82006c-11f2-43d8-b929-e161f9c506d4] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:57.603195 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4cc72d74-6a58-4b3f-a04b-4534ac24e318 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:57.604457 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4cc72d74-6a58-4b3f-a04b-4534ac24e318 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:57.604973 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4cc72d74-6a58-4b3f-a04b-4534ac24e318 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:57.606627 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4cc72d74-6a58-4b3f-a04b-4534ac24e318 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:57.607119 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4cc72d74-6a58-4b3f-a04b-4534ac24e318 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:57.607853 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4cc72d74-6a58-4b3f-a04b-4534ac24e318 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:57.792443 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-4cc72d74-6a58-4b3f-a04b-4534ac24e318 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:57.805169 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-4cc72d74-6a58-4b3f-a04b-4534ac24e318 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4" status: 200 len: 1612 microversion: 2.1 time: 0.220623 Sep 01 14:10:57.806093 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 304/623] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:57 2022] GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4 => generated 1612 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:57.812030 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-dd5c3b26-02b4-49e7-b8de-063b5f3ca5c2 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:57.815533 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-dd5c3b26-02b4-49e7-b8de-063b5f3ca5c2 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 929d6445-681f-48b3-b51f-495532864e64] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:57.826090 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-dd5c3b26-02b4-49e7-b8de-063b5f3ca5c2 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:57.826756 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-dd5c3b26-02b4-49e7-b8de-063b5f3ca5c2 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:57.827309 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-dd5c3b26-02b4-49e7-b8de-063b5f3ca5c2 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:57.828202 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-dd5c3b26-02b4-49e7-b8de-063b5f3ca5c2 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:57.829429 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-dd5c3b26-02b4-49e7-b8de-063b5f3ca5c2 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:57.830036 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-dd5c3b26-02b4-49e7-b8de-063b5f3ca5c2 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:58.020457 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-766c003a-21d6-4cb7-8307-1edc38fdd14c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:58.040964 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-766c003a-21d6-4cb7-8307-1edc38fdd14c tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1734 microversion: 2.1 time: 1.181492 Sep 01 14:10:58.044361 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 320/624] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:56 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1734 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:58.278971 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-dd5c3b26-02b4-49e7-b8de-063b5f3ca5c2 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53d275b44a2432a9fe8611304bcfa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d998735c243c3bcd08ca2e2d81ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:58.294210 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-dd5c3b26-02b4-49e7-b8de-063b5f3ca5c2 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "GET /compute/v2.1/servers/929d6445-681f-48b3-b51f-495532864e64" status: 200 len: 1318 microversion: 2.1 time: 0.486186 Sep 01 14:10:58.299173 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 305/625] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:57 2022] GET /compute/v2.1/servers/929d6445-681f-48b3-b51f-495532864e64 => generated 1318 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:58.583163 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [req-40b8d311-2c86-4ce6-8635-71265c069fc4 req-a382f829-908f-4f93-b171-35be537561cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e82006c-11f2-43d8-b929-e161f9c506d4", "name": "network-vif-deleted", "tag": "69252b21-42c1-4d12-b172-3cdc7e0d6d6b"}]} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:10:58.605151 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-40b8d311-2c86-4ce6-8635-71265c069fc4 req-a382f829-908f-4f93-b171-35be537561cc service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:58.611033 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-40b8d311-2c86-4ce6-8635-71265c069fc4 req-a382f829-908f-4f93-b171-35be537561cc service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:58.612884 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-40b8d311-2c86-4ce6-8635-71265c069fc4 req-a382f829-908f-4f93-b171-35be537561cc service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:58.621347 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-4d045839-4cdf-4e9e-a694-be237b168f46 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:58.623198 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-4d045839-4cdf-4e9e-a694-be237b168f46 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:58.637540 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4d045839-4cdf-4e9e-a694-be237b168f46 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:58.639735 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4d045839-4cdf-4e9e-a694-be237b168f46 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:58.641938 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4d045839-4cdf-4e9e-a694-be237b168f46 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:58.643527 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4d045839-4cdf-4e9e-a694-be237b168f46 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:58.644602 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4d045839-4cdf-4e9e-a694-be237b168f46 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:58.645678 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4d045839-4cdf-4e9e-a694-be237b168f46 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:58.654468 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.compute.server_external_events [req-40b8d311-2c86-4ce6-8635-71265c069fc4 req-a382f829-908f-4f93-b171-35be537561cc service nova] Creating event network-vif-deleted:69252b21-42c1-4d12-b172-3cdc7e0d6d6b for instance 3e82006c-11f2-43d8-b929-e161f9c506d4 on hv-cinder-85221 Sep 01 14:10:58.665036 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [req-40b8d311-2c86-4ce6-8635-71265c069fc4 req-a382f829-908f-4f93-b171-35be537561cc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087017 Sep 01 14:10:58.665656 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 321/626] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:10:58.830670 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-7d402e20-45d5-448c-9593-a96201665382 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:58.831686 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-7d402e20-45d5-448c-9593-a96201665382 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 3e82006c-11f2-43d8-b929-e161f9c506d4] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:58.839698 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7d402e20-45d5-448c-9593-a96201665382 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:58.840525 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7d402e20-45d5-448c-9593-a96201665382 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:58.841151 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7d402e20-45d5-448c-9593-a96201665382 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:58.842263 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7d402e20-45d5-448c-9593-a96201665382 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:58.842905 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7d402e20-45d5-448c-9593-a96201665382 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:58.843502 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7d402e20-45d5-448c-9593-a96201665382 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:58.927778 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-4d045839-4cdf-4e9e-a694-be237b168f46 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:58.948147 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-4d045839-4cdf-4e9e-a694-be237b168f46 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:58.951018 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-4d045839-4cdf-4e9e-a694-be237b168f46 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:58.953049 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-4d045839-4cdf-4e9e-a694-be237b168f46 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1338 microversion: 2.20 time: 0.356260 Sep 01 14:10:58.965933 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 306/627] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:10:58 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1338 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:10:58.991288 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-7d402e20-45d5-448c-9593-a96201665382 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:59.003755 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-7d402e20-45d5-448c-9593-a96201665382 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4" status: 200 len: 1325 microversion: 2.1 time: 0.177842 Sep 01 14:10:59.011777 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 322/628] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:58 2022] GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4 => generated 1325 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:59.069502 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-8cee96a5-60ec-4083-8fbd-a4dbb466d25f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:59.070653 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-8cee96a5-60ec-4083-8fbd-a4dbb466d25f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:59.086508 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8cee96a5-60ec-4083-8fbd-a4dbb466d25f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:59.088367 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8cee96a5-60ec-4083-8fbd-a4dbb466d25f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:59.088922 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8cee96a5-60ec-4083-8fbd-a4dbb466d25f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:59.090564 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8cee96a5-60ec-4083-8fbd-a4dbb466d25f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:59.091716 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8cee96a5-60ec-4083-8fbd-a4dbb466d25f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:59.092706 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8cee96a5-60ec-4083-8fbd-a4dbb466d25f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:59.331047 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-b584bdc7-61d9-4d8c-806f-86d5ae9b733d tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:59.340757 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-b584bdc7-61d9-4d8c-806f-86d5ae9b733d tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 929d6445-681f-48b3-b51f-495532864e64] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:59.343544 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b584bdc7-61d9-4d8c-806f-86d5ae9b733d tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:59.344407 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b584bdc7-61d9-4d8c-806f-86d5ae9b733d tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:59.345280 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b584bdc7-61d9-4d8c-806f-86d5ae9b733d tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:59.346436 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b584bdc7-61d9-4d8c-806f-86d5ae9b733d tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:59.347107 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b584bdc7-61d9-4d8c-806f-86d5ae9b733d tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:59.347857 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b584bdc7-61d9-4d8c-806f-86d5ae9b733d tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:59.765729 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-8cee96a5-60ec-4083-8fbd-a4dbb466d25f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:59.777739 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-8cee96a5-60ec-4083-8fbd-a4dbb466d25f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1734 microversion: 2.1 time: 0.716322 Sep 01 14:10:59.794665 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 307/629] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:59 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1734 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:59.801727 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [req-5e348cd4-c236-4cf6-9e8f-931f1dcb649f req-78c90942-b4d2-48f6-a530-a22fe732356b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "929d6445-681f-48b3-b51f-495532864e64", "tag": "06ddaa56-ca0c-4c1e-81a3-7eb78cc5666e"}]} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:10:59.815974 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-5e348cd4-c236-4cf6-9e8f-931f1dcb649f req-78c90942-b4d2-48f6-a530-a22fe732356b service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:59.816478 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-5e348cd4-c236-4cf6-9e8f-931f1dcb649f req-78c90942-b4d2-48f6-a530-a22fe732356b service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:59.816913 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-5e348cd4-c236-4cf6-9e8f-931f1dcb649f req-78c90942-b4d2-48f6-a530-a22fe732356b service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:59.830853 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.compute.server_external_events [req-5e348cd4-c236-4cf6-9e8f-931f1dcb649f req-78c90942-b4d2-48f6-a530-a22fe732356b service nova] Creating event network-changed:06ddaa56-ca0c-4c1e-81a3-7eb78cc5666e for instance 929d6445-681f-48b3-b51f-495532864e64 on hv-cinder-85221 Sep 01 14:10:59.837409 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [req-5e348cd4-c236-4cf6-9e8f-931f1dcb649f req-78c90942-b4d2-48f6-a530-a22fe732356b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041120 Sep 01 14:10:59.838125 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 308/630] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:10:59.891538 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-b584bdc7-61d9-4d8c-806f-86d5ae9b733d tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53d275b44a2432a9fe8611304bcfa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d998735c243c3bcd08ca2e2d81ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:59.903022 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-b584bdc7-61d9-4d8c-806f-86d5ae9b733d tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "GET /compute/v2.1/servers/929d6445-681f-48b3-b51f-495532864e64" status: 200 len: 1318 microversion: 2.1 time: 0.577606 Sep 01 14:10:59.904032 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 323/631] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:59 2022] GET /compute/v2.1/servers/929d6445-681f-48b3-b51f-495532864e64 => generated 1318 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:00.044347 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-7f708cfc-83a6-4584-bb80-137a6b6b1c87 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:00.045499 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-7f708cfc-83a6-4584-bb80-137a6b6b1c87 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 3e82006c-11f2-43d8-b929-e161f9c506d4] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:00.072885 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7f708cfc-83a6-4584-bb80-137a6b6b1c87 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:00.073814 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7f708cfc-83a6-4584-bb80-137a6b6b1c87 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:00.074657 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7f708cfc-83a6-4584-bb80-137a6b6b1c87 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:00.075960 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7f708cfc-83a6-4584-bb80-137a6b6b1c87 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:00.076810 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7f708cfc-83a6-4584-bb80-137a6b6b1c87 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:00.077593 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7f708cfc-83a6-4584-bb80-137a6b6b1c87 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:00.116322 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-5bf301da-9d04-48e4-b22a-5b5cac56a51e tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:00.117521 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-5bf301da-9d04-48e4-b22a-5b5cac56a51e tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:00.125538 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5bf301da-9d04-48e4-b22a-5b5cac56a51e tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:00.126658 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5bf301da-9d04-48e4-b22a-5b5cac56a51e tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:00.127557 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5bf301da-9d04-48e4-b22a-5b5cac56a51e tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:00.128477 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5bf301da-9d04-48e4-b22a-5b5cac56a51e tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:00.129143 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5bf301da-9d04-48e4-b22a-5b5cac56a51e tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:00.129580 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5bf301da-9d04-48e4-b22a-5b5cac56a51e tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:00.165305 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7f708cfc-83a6-4584-bb80-137a6b6b1c87 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:00.166230 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7f708cfc-83a6-4584-bb80-137a6b6b1c87 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:00.167027 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7f708cfc-83a6-4584-bb80-137a6b6b1c87 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:00.168093 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.objects.instance [None req-7f708cfc-83a6-4584-bb80-137a6b6b1c87 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lazy-loading 'fault' on Instance uuid 3e82006c-11f2-43d8-b929-e161f9c506d4 {{(pid=121340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:11:00.277812 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-7f708cfc-83a6-4584-bb80-137a6b6b1c87 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:00.291764 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-7f708cfc-83a6-4584-bb80-137a6b6b1c87 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4" status: 200 len: 1330 microversion: 2.1 time: 0.254590 Sep 01 14:11:00.293416 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 324/632] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:00 2022] GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4 => generated 1330 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:11:00.588648 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-5bf301da-9d04-48e4-b22a-5b5cac56a51e tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:00.610117 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-5bf301da-9d04-48e4-b22a-5b5cac56a51e tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:00.616025 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-5bf301da-9d04-48e4-b22a-5b5cac56a51e tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:00.618914 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-5bf301da-9d04-48e4-b22a-5b5cac56a51e tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1406 microversion: 2.20 time: 0.640738 Sep 01 14:11:00.620755 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 309/633] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:10:59 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1406 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:11:00.802911 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-7d0dd0a0-d21f-4351-9ae3-8fa79e028a2a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:00.803607 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-7d0dd0a0-d21f-4351-9ae3-8fa79e028a2a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:00.813224 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7d0dd0a0-d21f-4351-9ae3-8fa79e028a2a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:00.814410 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7d0dd0a0-d21f-4351-9ae3-8fa79e028a2a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:00.815025 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7d0dd0a0-d21f-4351-9ae3-8fa79e028a2a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:00.816470 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7d0dd0a0-d21f-4351-9ae3-8fa79e028a2a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:00.817257 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7d0dd0a0-d21f-4351-9ae3-8fa79e028a2a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:00.817968 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7d0dd0a0-d21f-4351-9ae3-8fa79e028a2a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:00.931300 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-0816f8aa-3c9a-4216-9a36-309b39dbb7e0 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:00.932317 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-0816f8aa-3c9a-4216-9a36-309b39dbb7e0 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 929d6445-681f-48b3-b51f-495532864e64] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:00.935704 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell0:SELECT=2 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:11:00.943904 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0816f8aa-3c9a-4216-9a36-309b39dbb7e0 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:00.944957 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0816f8aa-3c9a-4216-9a36-309b39dbb7e0 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:00.945636 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0816f8aa-3c9a-4216-9a36-309b39dbb7e0 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:00.946605 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0816f8aa-3c9a-4216-9a36-309b39dbb7e0 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:00.947253 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0816f8aa-3c9a-4216-9a36-309b39dbb7e0 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:00.947819 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0816f8aa-3c9a-4216-9a36-309b39dbb7e0 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:01.067312 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-7d0dd0a0-d21f-4351-9ae3-8fa79e028a2a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:01.089824 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-7d0dd0a0-d21f-4351-9ae3-8fa79e028a2a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1734 microversion: 2.1 time: 0.279706 Sep 01 14:11:01.089824 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 325/634] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:00 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1734 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:11:01.140043 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-0816f8aa-3c9a-4216-9a36-309b39dbb7e0 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53d275b44a2432a9fe8611304bcfa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d998735c243c3bcd08ca2e2d81ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:01.148952 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-0816f8aa-3c9a-4216-9a36-309b39dbb7e0 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "GET /compute/v2.1/servers/929d6445-681f-48b3-b51f-495532864e64" status: 200 len: 1318 microversion: 2.1 time: 0.223370 Sep 01 14:11:01.149558 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 310/635] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:00 2022] GET /compute/v2.1/servers/929d6445-681f-48b3-b51f-495532864e64 => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:11:01.332397 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-303ae94c-d659-42c2-8240-9700b816e25d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:01.333285 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-303ae94c-d659-42c2-8240-9700b816e25d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 3e82006c-11f2-43d8-b929-e161f9c506d4] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:01.336964 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell0:SELECT=2 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:11:01.343097 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-303ae94c-d659-42c2-8240-9700b816e25d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:01.343697 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-303ae94c-d659-42c2-8240-9700b816e25d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:01.344199 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-303ae94c-d659-42c2-8240-9700b816e25d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:01.345841 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-303ae94c-d659-42c2-8240-9700b816e25d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:01.346924 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-303ae94c-d659-42c2-8240-9700b816e25d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:01.347323 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-303ae94c-d659-42c2-8240-9700b816e25d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:01.363844 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.wsgi [None req-303ae94c-d659-42c2-8240-9700b816e25d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] HTTP exception thrown: Instance 3e82006c-11f2-43d8-b929-e161f9c506d4 could not be found. Sep 01 14:11:01.365554 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-303ae94c-d659-42c2-8240-9700b816e25d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Request method failure captured: Sep 01 14:11:01.365554 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: request: GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4 HTTP/1.1 Sep 01 14:11:01.365554 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept: application/json Sep 01 14:11:01.365554 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept-Encoding: identity Sep 01 14:11:01.365554 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Connection: close Sep 01 14:11:01.365554 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Length: 0 Sep 01 14:11:01.365554 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Type: application/json Sep 01 14:11:01.365554 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Host: 10.222.0.25 Sep 01 14:11:01.365554 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Openstack-System-Scope: None Sep 01 14:11:01.365554 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: User-Agent: python-urllib3/1.26.12 Sep 01 14:11:01.365554 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Auth-Token: gAAAAABjELyhZj5Hr9I4grX9g-sLmSzxOFwV6C8_UuPsJu0TTboeG4lPJ1EtlgmTO6Q18ohdm_zKgQxmrLRlDi5SpU-ZjSVzLIRa5u6LBsCTR0TutJimllLkII0Ts1UxHVT4475s7UI-5uK5aNVzYOSUMxaGRq9ZaCGPwi2wkROzwm6JUQLDfLI Sep 01 14:11:01.365554 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Id: None Sep 01 14:11:01.365554 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Name: None Sep 01 14:11:01.365554 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Identity-Status: Confirmed Sep 01 14:11:01.365554 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Is-Admin-Project: True Sep 01 14:11:01.365554 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Id: default Sep 01 14:11:01.365554 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Name: Default Sep 01 14:11:01.365554 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Id: 90a84500a899479aabfa3aeb72b4c4ae Sep 01 14:11:01.365554 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Name: tempest-AttachVolumeNegativeTest-836381067 Sep 01 14:11:01.365554 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Role: member,reader Sep 01 14:11:01.365554 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Roles: member,reader Sep 01 14:11:01.375283 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/90a84500a899479aabfa3aeb72b4c4ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/90a84500a899479aabfa3aeb72b4c4ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/90a84500a899479aabfa3aeb72b4c4ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_90a84500a899479aabfa3aeb72b4c4ae"}]}] Sep 01 14:11:01.375283 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant: tempest-AttachVolumeNegativeTest-836381067 Sep 01 14:11:01.375283 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Id: 90a84500a899479aabfa3aeb72b4c4ae Sep 01 14:11:01.375283 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-836381067 Sep 01 14:11:01.375283 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User: tempest-AttachVolumeNegativeTest-836381067-project Sep 01 14:11:01.375283 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Id: default Sep 01 14:11:01.375283 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Name: Default Sep 01 14:11:01.375283 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Id: 7ae66df61a764a42a1b1b15f54d5c34b Sep 01 14:11:01.375283 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Name: tempest-AttachVolumeNegativeTest-836381067-project Sep 01 14:11:01.375283 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: method: > Sep 01 14:11:01.375283 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: exception: Instance 3e82006c-11f2-43d8-b929-e161f9c506d4 could not be found. Sep 01 14:11:01.375283 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: action_args: {'id': '3e82006c-11f2-43d8-b929-e161f9c506d4'} Sep 01 14:11:01.377628 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:11:01.377628 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:11:01.377628 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:11:01.377628 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:11:01.377628 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:11:01.377628 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:11:01.377628 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:11:01.377628 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:11:01.377628 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:11:01.377628 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:11:01.377628 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e82006c-11f2-43d8-b929-e161f9c506d4 could not be found. Sep 01 14:11:01.377628 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:11:01.377628 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:11:01.377628 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:11:01.377628 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:11:01.377628 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:11:01.377628 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:11:01.377628 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:11:01.377628 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:11:01.377628 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:11:01.381531 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:11:01.381531 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:11:01.381531 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:11:01.381531 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:11:01.381531 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:11:01.381531 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:11:01.381531 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:11:01.381531 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e82006c-11f2-43d8-b929-e161f9c506d4 could not be found. Sep 01 14:11:01.381531 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:11:01.381531 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:11:01.381531 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:11:01.381531 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:11:01.381531 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:11:01.381531 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:11:01.381531 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:11:01.381531 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:11:01.381531 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e82006c-11f2-43d8-b929-e161f9c506d4 could not be found. Sep 01 14:11:01.381531 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:11:01.385238 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-303ae94c-d659-42c2-8240-9700b816e25d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Returning 404 to user: Instance 3e82006c-11f2-43d8-b929-e161f9c506d4 could not be found. {{(pid=121340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:11:01.385238 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-303ae94c-d659-42c2-8240-9700b816e25d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4" status: 404 len: 111 microversion: 2.1 time: 0.040377 Sep 01 14:11:01.385238 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 326/636] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:01 2022] GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 14:11:01.385888 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-754f79a8-5aeb-42a3-81d3-a4b280fc1400 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '.version_select at 0x7f98679819d0>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:01.533190 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell0:SELECT=8 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:11:01.655128 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-b3b08f77-e48e-4f18-8079-dab47b0369c8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:01.655903 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-b3b08f77-e48e-4f18-8079-dab47b0369c8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:01.662224 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b3b08f77-e48e-4f18-8079-dab47b0369c8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:01.662704 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b3b08f77-e48e-4f18-8079-dab47b0369c8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:01.663368 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b3b08f77-e48e-4f18-8079-dab47b0369c8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:01.664101 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b3b08f77-e48e-4f18-8079-dab47b0369c8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:01.664551 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b3b08f77-e48e-4f18-8079-dab47b0369c8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:01.664967 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b3b08f77-e48e-4f18-8079-dab47b0369c8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:01.741059 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-754f79a8-5aeb-42a3-81d3-a4b280fc1400 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-708943441" status: 202 len: 0 microversion: 2.1 time: 0.366001 Sep 01 14:11:01.741765 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 311/637] 10.222.0.25 () {58 vars in 1218 bytes} [Thu Sep 1 14:11:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-708943441 => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:11:01.838675 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-b3b08f77-e48e-4f18-8079-dab47b0369c8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:01.840767 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [req-629cc275-3ebe-460c-9c38-f7c8c1b99af8 req-05d788a9-5b05-46fd-a63a-e7a323d3b5b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1", "tag": "214b6ab8-206c-4129-a639-f69abbdaa49b"}]} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:11:01.859550 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-b3b08f77-e48e-4f18-8079-dab47b0369c8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:01.864052 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-629cc275-3ebe-460c-9c38-f7c8c1b99af8 req-05d788a9-5b05-46fd-a63a-e7a323d3b5b0 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:01.864988 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-629cc275-3ebe-460c-9c38-f7c8c1b99af8 req-05d788a9-5b05-46fd-a63a-e7a323d3b5b0 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:01.865818 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-629cc275-3ebe-460c-9c38-f7c8c1b99af8 req-05d788a9-5b05-46fd-a63a-e7a323d3b5b0 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:01.867593 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-b3b08f77-e48e-4f18-8079-dab47b0369c8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:01.870064 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-b3b08f77-e48e-4f18-8079-dab47b0369c8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1406 microversion: 2.20 time: 0.218513 Sep 01 14:11:01.872373 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 327/638] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:11:01 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1406 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:11:01.910404 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.compute.server_external_events [req-629cc275-3ebe-460c-9c38-f7c8c1b99af8 req-05d788a9-5b05-46fd-a63a-e7a323d3b5b0 service nova] Creating event network-changed:214b6ab8-206c-4129-a639-f69abbdaa49b for instance d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 on hv-cinder-85221 Sep 01 14:11:01.920960 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [req-629cc275-3ebe-460c-9c38-f7c8c1b99af8 req-05d788a9-5b05-46fd-a63a-e7a323d3b5b0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090827 Sep 01 14:11:01.922212 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 312/639] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:11:02.109655 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-8cfbc887-ba34-4c45-a1d5-c439dd55e926 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:02.116071 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-8cfbc887-ba34-4c45-a1d5-c439dd55e926 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:02.124862 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8cfbc887-ba34-4c45-a1d5-c439dd55e926 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:02.125850 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8cfbc887-ba34-4c45-a1d5-c439dd55e926 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:02.126851 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8cfbc887-ba34-4c45-a1d5-c439dd55e926 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:02.128678 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8cfbc887-ba34-4c45-a1d5-c439dd55e926 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:02.129707 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8cfbc887-ba34-4c45-a1d5-c439dd55e926 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:02.130892 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8cfbc887-ba34-4c45-a1d5-c439dd55e926 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:02.177183 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-e73fa51f-8d3e-418c-99cb-32b41a423afb tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:02.178541 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-e73fa51f-8d3e-418c-99cb-32b41a423afb tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 929d6445-681f-48b3-b51f-495532864e64] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:02.194504 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e73fa51f-8d3e-418c-99cb-32b41a423afb tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:02.195777 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e73fa51f-8d3e-418c-99cb-32b41a423afb tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:02.196805 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e73fa51f-8d3e-418c-99cb-32b41a423afb tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:02.198455 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e73fa51f-8d3e-418c-99cb-32b41a423afb tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:02.199576 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e73fa51f-8d3e-418c-99cb-32b41a423afb tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:02.200578 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e73fa51f-8d3e-418c-99cb-32b41a423afb tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:02.414784 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-8cfbc887-ba34-4c45-a1d5-c439dd55e926 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:02.436562 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-8cfbc887-ba34-4c45-a1d5-c439dd55e926 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1734 microversion: 2.1 time: 0.337778 Sep 01 14:11:02.439204 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 328/640] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:02 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1734 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:02.510717 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-e73fa51f-8d3e-418c-99cb-32b41a423afb tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53d275b44a2432a9fe8611304bcfa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d998735c243c3bcd08ca2e2d81ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:02.539479 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-e73fa51f-8d3e-418c-99cb-32b41a423afb tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "GET /compute/v2.1/servers/929d6445-681f-48b3-b51f-495532864e64" status: 200 len: 1318 microversion: 2.1 time: 0.365993 Sep 01 14:11:02.545380 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 313/641] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:02 2022] GET /compute/v2.1/servers/929d6445-681f-48b3-b51f-495532864e64 => generated 1318 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:11:02.897930 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-dc593ad4-cf9f-4eba-93e9-88ee4499c4a6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:02.899210 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-dc593ad4-cf9f-4eba-93e9-88ee4499c4a6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:02.906965 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-dc593ad4-cf9f-4eba-93e9-88ee4499c4a6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:02.908554 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-dc593ad4-cf9f-4eba-93e9-88ee4499c4a6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:02.909248 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-dc593ad4-cf9f-4eba-93e9-88ee4499c4a6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:02.910412 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-dc593ad4-cf9f-4eba-93e9-88ee4499c4a6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:02.911206 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-dc593ad4-cf9f-4eba-93e9-88ee4499c4a6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:02.912001 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-dc593ad4-cf9f-4eba-93e9-88ee4499c4a6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:02.938304 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell0:SELECT=16 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:11:03.284645 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-dc593ad4-cf9f-4eba-93e9-88ee4499c4a6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:03.300295 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-dc593ad4-cf9f-4eba-93e9-88ee4499c4a6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:03.302311 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-dc593ad4-cf9f-4eba-93e9-88ee4499c4a6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:03.318139 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-dc593ad4-cf9f-4eba-93e9-88ee4499c4a6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1406 microversion: 2.20 time: 0.412190 Sep 01 14:11:03.318139 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 329/642] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:11:02 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1406 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:11:03.473366 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-b1fefb5f-b1f3-487e-bbad-549d905f8320 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:03.475567 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-b1fefb5f-b1f3-487e-bbad-549d905f8320 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:03.487289 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b1fefb5f-b1f3-487e-bbad-549d905f8320 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:03.488262 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b1fefb5f-b1f3-487e-bbad-549d905f8320 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:03.489206 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b1fefb5f-b1f3-487e-bbad-549d905f8320 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:03.490700 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b1fefb5f-b1f3-487e-bbad-549d905f8320 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:03.493607 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b1fefb5f-b1f3-487e-bbad-549d905f8320 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:03.494103 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b1fefb5f-b1f3-487e-bbad-549d905f8320 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:03.575619 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-022eaa17-2d9a-4673-87a4-a0dad0ab6c70 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:03.576772 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-022eaa17-2d9a-4673-87a4-a0dad0ab6c70 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 929d6445-681f-48b3-b51f-495532864e64] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:03.587298 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:11:03.590375 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-022eaa17-2d9a-4673-87a4-a0dad0ab6c70 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:03.591195 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-022eaa17-2d9a-4673-87a4-a0dad0ab6c70 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:03.592283 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-022eaa17-2d9a-4673-87a4-a0dad0ab6c70 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:03.593868 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-022eaa17-2d9a-4673-87a4-a0dad0ab6c70 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:03.595008 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-022eaa17-2d9a-4673-87a4-a0dad0ab6c70 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:03.596029 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-022eaa17-2d9a-4673-87a4-a0dad0ab6c70 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:03.787506 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-b1fefb5f-b1f3-487e-bbad-549d905f8320 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:03.799689 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-b1fefb5f-b1f3-487e-bbad-549d905f8320 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1734 microversion: 2.1 time: 0.331536 Sep 01 14:11:03.808113 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 314/643] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:03 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1734 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:03.824045 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-ba176719-a041-416e-9e9c-c62dd1edf50b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:03.824827 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-ba176719-a041-416e-9e9c-c62dd1edf50b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 91814986-adf4-46cb-8edf-820106d37ecb] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:03.833124 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ba176719-a041-416e-9e9c-c62dd1edf50b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:03.833626 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ba176719-a041-416e-9e9c-c62dd1edf50b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:03.834109 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ba176719-a041-416e-9e9c-c62dd1edf50b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:03.834922 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ba176719-a041-416e-9e9c-c62dd1edf50b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:03.835390 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ba176719-a041-416e-9e9c-c62dd1edf50b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:03.835897 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ba176719-a041-416e-9e9c-c62dd1edf50b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:03.883396 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-022eaa17-2d9a-4673-87a4-a0dad0ab6c70 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53d275b44a2432a9fe8611304bcfa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d998735c243c3bcd08ca2e2d81ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:03.885852 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell1:SELECT=100 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:11:03.893794 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-022eaa17-2d9a-4673-87a4-a0dad0ab6c70 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "GET /compute/v2.1/servers/929d6445-681f-48b3-b51f-495532864e64" status: 200 len: 1318 microversion: 2.1 time: 0.326689 Sep 01 14:11:03.896055 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 330/644] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:03 2022] GET /compute/v2.1/servers/929d6445-681f-48b3-b51f-495532864e64 => generated 1318 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:11:03.935721 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.objects.instance [None req-ba176719-a041-416e-9e9c-c62dd1edf50b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lazy-loading 'services' on Instance uuid 91814986-adf4-46cb-8edf-820106d37ecb {{(pid=121339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:11:04.071168 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell1:SELECT=100 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:11:04.168384 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-ba176719-a041-416e-9e9c-c62dd1edf50b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "DELETE /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb/os-volume_attachments/c504c147-522f-4221-acc3-2090374b1b08" status: 202 len: 0 microversion: 2.1 time: 0.348953 Sep 01 14:11:04.169041 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 315/645] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Sep 1 14:11:03 2022] DELETE /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb/os-volume_attachments/c504c147-522f-4221-acc3-2090374b1b08 => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:11:04.183694 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-88fda3cc-4b62-483d-9efc-3f9738e13736 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:04.189311 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-88fda3cc-4b62-483d-9efc-3f9738e13736 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 91814986-adf4-46cb-8edf-820106d37ecb] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:04.199818 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-88fda3cc-4b62-483d-9efc-3f9738e13736 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:04.200330 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-88fda3cc-4b62-483d-9efc-3f9738e13736 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:04.200759 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-88fda3cc-4b62-483d-9efc-3f9738e13736 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:04.201487 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-88fda3cc-4b62-483d-9efc-3f9738e13736 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:04.201965 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-88fda3cc-4b62-483d-9efc-3f9738e13736 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:04.202397 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-88fda3cc-4b62-483d-9efc-3f9738e13736 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:04.240630 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-88fda3cc-4b62-483d-9efc-3f9738e13736 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064701 Sep 01 14:11:04.241226 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 331/646] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 14:11:04 2022] GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:11:04.332183 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-5383fb34-d000-4f0b-a89d-171d0e9440b1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:04.333751 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-5383fb34-d000-4f0b-a89d-171d0e9440b1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:04.341862 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5383fb34-d000-4f0b-a89d-171d0e9440b1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:04.342644 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5383fb34-d000-4f0b-a89d-171d0e9440b1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:04.343222 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5383fb34-d000-4f0b-a89d-171d0e9440b1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:04.344067 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5383fb34-d000-4f0b-a89d-171d0e9440b1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:04.345444 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5383fb34-d000-4f0b-a89d-171d0e9440b1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:04.346106 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5383fb34-d000-4f0b-a89d-171d0e9440b1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:04.521089 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-5383fb34-d000-4f0b-a89d-171d0e9440b1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:04.530577 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-5383fb34-d000-4f0b-a89d-171d0e9440b1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:04.532251 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-5383fb34-d000-4f0b-a89d-171d0e9440b1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:04.533519 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-5383fb34-d000-4f0b-a89d-171d0e9440b1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1406 microversion: 2.20 time: 0.208277 Sep 01 14:11:04.534132 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 316/647] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:11:04 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1406 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:11:04.825263 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-7f13eab6-3a6c-41af-bd80-06531531721d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:04.825980 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-7f13eab6-3a6c-41af-bd80-06531531721d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:04.832938 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7f13eab6-3a6c-41af-bd80-06531531721d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:04.833427 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7f13eab6-3a6c-41af-bd80-06531531721d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:04.833866 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7f13eab6-3a6c-41af-bd80-06531531721d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:04.834619 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7f13eab6-3a6c-41af-bd80-06531531721d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:04.835079 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7f13eab6-3a6c-41af-bd80-06531531721d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:04.835514 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7f13eab6-3a6c-41af-bd80-06531531721d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:04.934483 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-24e7e91e-bd38-40d0-8e58-ed17f3f62bfb tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:04.935104 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-24e7e91e-bd38-40d0-8e58-ed17f3f62bfb tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 929d6445-681f-48b3-b51f-495532864e64] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:04.942171 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-24e7e91e-bd38-40d0-8e58-ed17f3f62bfb tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:04.942559 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-24e7e91e-bd38-40d0-8e58-ed17f3f62bfb tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:04.943003 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-24e7e91e-bd38-40d0-8e58-ed17f3f62bfb tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:04.943757 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-24e7e91e-bd38-40d0-8e58-ed17f3f62bfb tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:04.944229 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-24e7e91e-bd38-40d0-8e58-ed17f3f62bfb tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:04.944662 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-24e7e91e-bd38-40d0-8e58-ed17f3f62bfb tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:05.065418 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-7f13eab6-3a6c-41af-bd80-06531531721d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:05.081563 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-7f13eab6-3a6c-41af-bd80-06531531721d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1734 microversion: 2.1 time: 0.260067 Sep 01 14:11:05.099248 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 332/648] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:04 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1734 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:05.164827 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-24e7e91e-bd38-40d0-8e58-ed17f3f62bfb tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53d275b44a2432a9fe8611304bcfa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d998735c243c3bcd08ca2e2d81ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:05.175684 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-24e7e91e-bd38-40d0-8e58-ed17f3f62bfb tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "GET /compute/v2.1/servers/929d6445-681f-48b3-b51f-495532864e64" status: 200 len: 1318 microversion: 2.1 time: 0.245155 Sep 01 14:11:05.176448 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 317/649] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:04 2022] GET /compute/v2.1/servers/929d6445-681f-48b3-b51f-495532864e64 => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:11:05.253939 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-7506b803-29d1-48fd-b6d2-d2f3ba3cbe57 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:05.256851 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-7506b803-29d1-48fd-b6d2-d2f3ba3cbe57 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 91814986-adf4-46cb-8edf-820106d37ecb] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:05.264106 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7506b803-29d1-48fd-b6d2-d2f3ba3cbe57 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:05.264634 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7506b803-29d1-48fd-b6d2-d2f3ba3cbe57 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:05.265116 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7506b803-29d1-48fd-b6d2-d2f3ba3cbe57 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:05.265990 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7506b803-29d1-48fd-b6d2-d2f3ba3cbe57 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:05.267230 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7506b803-29d1-48fd-b6d2-d2f3ba3cbe57 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:05.267670 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7506b803-29d1-48fd-b6d2-d2f3ba3cbe57 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:05.301970 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-7506b803-29d1-48fd-b6d2-d2f3ba3cbe57 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052748 Sep 01 14:11:05.302547 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 333/650] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 14:11:05 2022] GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:11:05.558912 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-b13a80d5-e0ee-4743-8730-f7fc986d5837 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:05.559977 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-b13a80d5-e0ee-4743-8730-f7fc986d5837 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:05.574486 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b13a80d5-e0ee-4743-8730-f7fc986d5837 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:05.575380 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b13a80d5-e0ee-4743-8730-f7fc986d5837 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:05.576161 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b13a80d5-e0ee-4743-8730-f7fc986d5837 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:05.577292 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b13a80d5-e0ee-4743-8730-f7fc986d5837 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:05.578030 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b13a80d5-e0ee-4743-8730-f7fc986d5837 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:05.578679 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b13a80d5-e0ee-4743-8730-f7fc986d5837 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:05.759616 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-b13a80d5-e0ee-4743-8730-f7fc986d5837 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:05.770391 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-b13a80d5-e0ee-4743-8730-f7fc986d5837 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:05.771928 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-b13a80d5-e0ee-4743-8730-f7fc986d5837 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:05.773155 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-b13a80d5-e0ee-4743-8730-f7fc986d5837 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1406 microversion: 2.20 time: 0.218335 Sep 01 14:11:05.773747 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 318/651] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:11:05 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1406 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:11:06.123021 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-998d234b-5104-48cf-873d-4de3f7aa97bf tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:06.124180 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-998d234b-5104-48cf-873d-4de3f7aa97bf tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:06.136504 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-998d234b-5104-48cf-873d-4de3f7aa97bf tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:06.137131 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-998d234b-5104-48cf-873d-4de3f7aa97bf tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:06.137688 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-998d234b-5104-48cf-873d-4de3f7aa97bf tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:06.138553 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-998d234b-5104-48cf-873d-4de3f7aa97bf tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:06.139126 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-998d234b-5104-48cf-873d-4de3f7aa97bf tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:06.139672 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-998d234b-5104-48cf-873d-4de3f7aa97bf tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:06.209708 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-765ebac5-70cd-40e9-b156-84d2bf003e3b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:06.211919 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-765ebac5-70cd-40e9-b156-84d2bf003e3b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 929d6445-681f-48b3-b51f-495532864e64] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:06.220776 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-765ebac5-70cd-40e9-b156-84d2bf003e3b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:06.221283 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-765ebac5-70cd-40e9-b156-84d2bf003e3b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:06.221726 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-765ebac5-70cd-40e9-b156-84d2bf003e3b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:06.222508 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-765ebac5-70cd-40e9-b156-84d2bf003e3b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:06.223005 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-765ebac5-70cd-40e9-b156-84d2bf003e3b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:06.223439 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-765ebac5-70cd-40e9-b156-84d2bf003e3b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:06.363991 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-998d234b-5104-48cf-873d-4de3f7aa97bf tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:06.382860 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-998d234b-5104-48cf-873d-4de3f7aa97bf tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1734 microversion: 2.1 time: 0.261204 Sep 01 14:11:06.382860 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 334/652] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:06 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1734 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:06.387089 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-ab785a53-faf2-4461-93c3-c4546877f641 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:06.392034 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-ab785a53-faf2-4461-93c3-c4546877f641 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 91814986-adf4-46cb-8edf-820106d37ecb] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:06.404489 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ab785a53-faf2-4461-93c3-c4546877f641 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:06.405254 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ab785a53-faf2-4461-93c3-c4546877f641 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:06.405771 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ab785a53-faf2-4461-93c3-c4546877f641 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:06.406689 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ab785a53-faf2-4461-93c3-c4546877f641 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:06.407253 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ab785a53-faf2-4461-93c3-c4546877f641 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:06.407930 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ab785a53-faf2-4461-93c3-c4546877f641 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:06.424346 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-765ebac5-70cd-40e9-b156-84d2bf003e3b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53d275b44a2432a9fe8611304bcfa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d998735c243c3bcd08ca2e2d81ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:06.448092 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-ab785a53-faf2-4461-93c3-c4546877f641 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068973 Sep 01 14:11:06.448693 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 335/653] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 14:11:06 2022] GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:11:06.449389 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-765ebac5-70cd-40e9-b156-84d2bf003e3b tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "GET /compute/v2.1/servers/929d6445-681f-48b3-b51f-495532864e64" status: 200 len: 1318 microversion: 2.1 time: 0.238422 Sep 01 14:11:06.450389 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 319/654] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:06 2022] GET /compute/v2.1/servers/929d6445-681f-48b3-b51f-495532864e64 => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:11:06.575897 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [req-1317d530-1f7b-43f8-9f34-08537f1bf6d8 req-6cebaf0c-15df-4c54-8f49-4b0c73863337 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "929d6445-681f-48b3-b51f-495532864e64", "name": "network-vif-plugged", "status": "completed", "tag": "06ddaa56-ca0c-4c1e-81a3-7eb78cc5666e"}]} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:11:06.589246 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-1317d530-1f7b-43f8-9f34-08537f1bf6d8 req-6cebaf0c-15df-4c54-8f49-4b0c73863337 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:06.589735 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-1317d530-1f7b-43f8-9f34-08537f1bf6d8 req-6cebaf0c-15df-4c54-8f49-4b0c73863337 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:06.590248 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-1317d530-1f7b-43f8-9f34-08537f1bf6d8 req-6cebaf0c-15df-4c54-8f49-4b0c73863337 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:06.606860 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.compute.server_external_events [req-1317d530-1f7b-43f8-9f34-08537f1bf6d8 req-6cebaf0c-15df-4c54-8f49-4b0c73863337 service nova] Creating event network-vif-plugged:06ddaa56-ca0c-4c1e-81a3-7eb78cc5666e for instance 929d6445-681f-48b3-b51f-495532864e64 on hv-cinder-85221 Sep 01 14:11:06.614313 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [req-1317d530-1f7b-43f8-9f34-08537f1bf6d8 req-6cebaf0c-15df-4c54-8f49-4b0c73863337 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043751 Sep 01 14:11:06.615255 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 336/655] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:11:06.797190 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-04216cdc-8a25-40fa-b174-ba844b1f0de5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:06.798109 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-04216cdc-8a25-40fa-b174-ba844b1f0de5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:06.805120 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-04216cdc-8a25-40fa-b174-ba844b1f0de5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:06.805637 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-04216cdc-8a25-40fa-b174-ba844b1f0de5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:06.806123 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-04216cdc-8a25-40fa-b174-ba844b1f0de5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:06.806841 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-04216cdc-8a25-40fa-b174-ba844b1f0de5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:06.807305 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-04216cdc-8a25-40fa-b174-ba844b1f0de5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:06.807731 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-04216cdc-8a25-40fa-b174-ba844b1f0de5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:06.968131 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-04216cdc-8a25-40fa-b174-ba844b1f0de5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:06.977470 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-04216cdc-8a25-40fa-b174-ba844b1f0de5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:06.979042 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-04216cdc-8a25-40fa-b174-ba844b1f0de5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:06.980198 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-04216cdc-8a25-40fa-b174-ba844b1f0de5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1406 microversion: 2.20 time: 0.187207 Sep 01 14:11:06.980820 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 320/656] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:11:06 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1406 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:11:07.461885 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-02cb0c58-b105-4795-bd8b-75ac073fd8e7 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:07.464259 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-02cb0c58-b105-4795-bd8b-75ac073fd8e7 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 91814986-adf4-46cb-8edf-820106d37ecb] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:07.474988 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-02cb0c58-b105-4795-bd8b-75ac073fd8e7 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:07.476087 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-02cb0c58-b105-4795-bd8b-75ac073fd8e7 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:07.476907 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-02cb0c58-b105-4795-bd8b-75ac073fd8e7 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:07.479527 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-02cb0c58-b105-4795-bd8b-75ac073fd8e7 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:07.489876 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-02cb0c58-b105-4795-bd8b-75ac073fd8e7 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:07.490910 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-02cb0c58-b105-4795-bd8b-75ac073fd8e7 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:07.558432 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-02cb0c58-b105-4795-bd8b-75ac073fd8e7 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100347 Sep 01 14:11:07.567358 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 321/657] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 14:11:07 2022] GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:11:07.580183 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-abfa028b-b1c8-4345-93b4-ba7e70b113ea tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:07.581017 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-abfa028b-b1c8-4345-93b4-ba7e70b113ea tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 929d6445-681f-48b3-b51f-495532864e64] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:07.588524 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-abfa028b-b1c8-4345-93b4-ba7e70b113ea tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:07.589249 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-abfa028b-b1c8-4345-93b4-ba7e70b113ea tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:07.589767 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-abfa028b-b1c8-4345-93b4-ba7e70b113ea tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:07.590687 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-abfa028b-b1c8-4345-93b4-ba7e70b113ea tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:07.591010 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-70618e8e-fb9a-4ffc-9cf5-0a3d321b71f8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:07.591762 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-abfa028b-b1c8-4345-93b4-ba7e70b113ea tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:07.591762 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-abfa028b-b1c8-4345-93b4-ba7e70b113ea tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:07.593480 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-70618e8e-fb9a-4ffc-9cf5-0a3d321b71f8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:07.615370 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-70618e8e-fb9a-4ffc-9cf5-0a3d321b71f8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:07.619319 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-70618e8e-fb9a-4ffc-9cf5-0a3d321b71f8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:07.619319 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-70618e8e-fb9a-4ffc-9cf5-0a3d321b71f8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:07.619319 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-70618e8e-fb9a-4ffc-9cf5-0a3d321b71f8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:07.620077 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-70618e8e-fb9a-4ffc-9cf5-0a3d321b71f8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:07.621104 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-70618e8e-fb9a-4ffc-9cf5-0a3d321b71f8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:07.822846 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-abfa028b-b1c8-4345-93b4-ba7e70b113ea tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53d275b44a2432a9fe8611304bcfa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d998735c243c3bcd08ca2e2d81ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:07.834718 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-abfa028b-b1c8-4345-93b4-ba7e70b113ea tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "GET /compute/v2.1/servers/929d6445-681f-48b3-b51f-495532864e64" status: 200 len: 1318 microversion: 2.1 time: 0.266005 Sep 01 14:11:07.836380 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 322/658] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:07 2022] GET /compute/v2.1/servers/929d6445-681f-48b3-b51f-495532864e64 => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:07.862614 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-70618e8e-fb9a-4ffc-9cf5-0a3d321b71f8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:07.878662 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-70618e8e-fb9a-4ffc-9cf5-0a3d321b71f8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1734 microversion: 2.1 time: 0.469125 Sep 01 14:11:07.879507 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 337/659] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:07 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1734 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:08.005450 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-4309447f-3b53-4bde-96a9-4c7e15605e70 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:08.006280 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-4309447f-3b53-4bde-96a9-4c7e15605e70 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:08.013422 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4309447f-3b53-4bde-96a9-4c7e15605e70 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:08.013934 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4309447f-3b53-4bde-96a9-4c7e15605e70 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:08.014379 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4309447f-3b53-4bde-96a9-4c7e15605e70 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:08.015102 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4309447f-3b53-4bde-96a9-4c7e15605e70 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:08.015564 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4309447f-3b53-4bde-96a9-4c7e15605e70 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:08.015985 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4309447f-3b53-4bde-96a9-4c7e15605e70 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:08.215945 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-4309447f-3b53-4bde-96a9-4c7e15605e70 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:08.226704 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-4309447f-3b53-4bde-96a9-4c7e15605e70 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:08.228190 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-4309447f-3b53-4bde-96a9-4c7e15605e70 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:08.229547 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-4309447f-3b53-4bde-96a9-4c7e15605e70 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1406 microversion: 2.20 time: 0.229070 Sep 01 14:11:08.230166 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 323/660] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:11:07 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:11:08.574888 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-0ab799ad-4371-478b-84b1-3b2bc3c2e341 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:08.577521 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-0ab799ad-4371-478b-84b1-3b2bc3c2e341 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 91814986-adf4-46cb-8edf-820106d37ecb] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:08.585742 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0ab799ad-4371-478b-84b1-3b2bc3c2e341 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:08.586264 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0ab799ad-4371-478b-84b1-3b2bc3c2e341 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:08.586700 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0ab799ad-4371-478b-84b1-3b2bc3c2e341 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:08.587436 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0ab799ad-4371-478b-84b1-3b2bc3c2e341 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:08.587900 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0ab799ad-4371-478b-84b1-3b2bc3c2e341 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:08.588328 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0ab799ad-4371-478b-84b1-3b2bc3c2e341 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:08.624704 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-0ab799ad-4371-478b-84b1-3b2bc3c2e341 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053892 Sep 01 14:11:08.626084 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 338/661] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 14:11:08 2022] GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 01 14:11:08.728619 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-ab361cec-dd43-4fe5-8835-f74e3282b737 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:08.729208 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-ab361cec-dd43-4fe5-8835-f74e3282b737 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 91814986-adf4-46cb-8edf-820106d37ecb] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:08.736683 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ab361cec-dd43-4fe5-8835-f74e3282b737 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:08.737229 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ab361cec-dd43-4fe5-8835-f74e3282b737 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:08.737712 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ab361cec-dd43-4fe5-8835-f74e3282b737 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:08.738626 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ab361cec-dd43-4fe5-8835-f74e3282b737 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:08.739176 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ab361cec-dd43-4fe5-8835-f74e3282b737 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:08.739756 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ab361cec-dd43-4fe5-8835-f74e3282b737 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:08.772291 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-ab361cec-dd43-4fe5-8835-f74e3282b737 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 91814986-adf4-46cb-8edf-820106d37ecb] Going to try to terminate instance {{(pid=121339) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:11:08.870324 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-1e4bfb2d-48c1-45d3-9c62-2df739de10c4 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:08.870954 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-1e4bfb2d-48c1-45d3-9c62-2df739de10c4 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 929d6445-681f-48b3-b51f-495532864e64] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:08.878813 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1e4bfb2d-48c1-45d3-9c62-2df739de10c4 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:08.879364 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1e4bfb2d-48c1-45d3-9c62-2df739de10c4 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:08.879884 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1e4bfb2d-48c1-45d3-9c62-2df739de10c4 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:08.880735 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1e4bfb2d-48c1-45d3-9c62-2df739de10c4 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:08.881249 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1e4bfb2d-48c1-45d3-9c62-2df739de10c4 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:08.881725 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1e4bfb2d-48c1-45d3-9c62-2df739de10c4 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:09.072686 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-1e4bfb2d-48c1-45d3-9c62-2df739de10c4 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53d275b44a2432a9fe8611304bcfa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d998735c243c3bcd08ca2e2d81ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:09.102237 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-1e4bfb2d-48c1-45d3-9c62-2df739de10c4 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "GET /compute/v2.1/servers/929d6445-681f-48b3-b51f-495532864e64" status: 200 len: 1318 microversion: 2.1 time: 0.222414 Sep 01 14:11:09.102237 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 339/662] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:08 2022] GET /compute/v2.1/servers/929d6445-681f-48b3-b51f-495532864e64 => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:11:09.102237 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-6acb789c-8ca6-41e3-8608-e369df5652ff tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:09.102237 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-6acb789c-8ca6-41e3-8608-e369df5652ff tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:09.109514 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6acb789c-8ca6-41e3-8608-e369df5652ff tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:09.110337 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6acb789c-8ca6-41e3-8608-e369df5652ff tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:09.110776 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6acb789c-8ca6-41e3-8608-e369df5652ff tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:09.111761 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6acb789c-8ca6-41e3-8608-e369df5652ff tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:09.112312 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6acb789c-8ca6-41e3-8608-e369df5652ff tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:09.112882 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-ab361cec-dd43-4fe5-8835-f74e3282b737 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "DELETE /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb" status: 204 len: 0 microversion: 2.1 time: 0.387334 Sep 01 14:11:09.113740 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6acb789c-8ca6-41e3-8608-e369df5652ff tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:09.114235 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 324/663] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 14:11:08 2022] DELETE /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 14:11:09.134278 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-5811396a-eb6c-4309-a5dc-d0f743602a1d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:09.135540 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-5811396a-eb6c-4309-a5dc-d0f743602a1d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 91814986-adf4-46cb-8edf-820106d37ecb] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:09.147194 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:11:09.150574 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5811396a-eb6c-4309-a5dc-d0f743602a1d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:09.151765 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5811396a-eb6c-4309-a5dc-d0f743602a1d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:09.152774 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5811396a-eb6c-4309-a5dc-d0f743602a1d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:09.154372 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5811396a-eb6c-4309-a5dc-d0f743602a1d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:09.156367 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5811396a-eb6c-4309-a5dc-d0f743602a1d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:09.157532 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5811396a-eb6c-4309-a5dc-d0f743602a1d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:09.367325 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-6acb789c-8ca6-41e3-8608-e369df5652ff tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:09.383823 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-6acb789c-8ca6-41e3-8608-e369df5652ff tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1734 microversion: 2.1 time: 0.292015 Sep 01 14:11:09.384536 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 340/664] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:09 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1734 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:09.391031 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-bde4e70e-0756-4a1c-9bd9-5479a01f3e42 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:09.392074 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-bde4e70e-0756-4a1c-9bd9-5479a01f3e42 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:09.400808 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bde4e70e-0756-4a1c-9bd9-5479a01f3e42 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:09.401483 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bde4e70e-0756-4a1c-9bd9-5479a01f3e42 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:09.402145 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bde4e70e-0756-4a1c-9bd9-5479a01f3e42 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:09.403138 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bde4e70e-0756-4a1c-9bd9-5479a01f3e42 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:09.403911 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bde4e70e-0756-4a1c-9bd9-5479a01f3e42 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:09.404633 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bde4e70e-0756-4a1c-9bd9-5479a01f3e42 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:09.414011 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-5811396a-eb6c-4309-a5dc-d0f743602a1d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:09.423596 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-5811396a-eb6c-4309-a5dc-d0f743602a1d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb" status: 200 len: 1684 microversion: 2.1 time: 0.297860 Sep 01 14:11:09.424505 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 325/665] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:09 2022] GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb => generated 1684 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:09.602158 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-bde4e70e-0756-4a1c-9bd9-5479a01f3e42 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:09.612350 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-bde4e70e-0756-4a1c-9bd9-5479a01f3e42 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:09.615012 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-bde4e70e-0756-4a1c-9bd9-5479a01f3e42 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:09.616386 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-bde4e70e-0756-4a1c-9bd9-5479a01f3e42 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1406 microversion: 2.20 time: 0.230751 Sep 01 14:11:09.617024 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 341/666] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:11:09 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1406 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:11:10.114484 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-a1b65e57-f482-4c30-9bdd-e9f9eda2976d tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:10.115584 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-a1b65e57-f482-4c30-9bdd-e9f9eda2976d tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 929d6445-681f-48b3-b51f-495532864e64] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:10.124739 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a1b65e57-f482-4c30-9bdd-e9f9eda2976d tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:10.129442 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a1b65e57-f482-4c30-9bdd-e9f9eda2976d tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:10.129442 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a1b65e57-f482-4c30-9bdd-e9f9eda2976d tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:10.129442 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a1b65e57-f482-4c30-9bdd-e9f9eda2976d tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:10.129442 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a1b65e57-f482-4c30-9bdd-e9f9eda2976d tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:10.130387 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a1b65e57-f482-4c30-9bdd-e9f9eda2976d tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:10.315228 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-a1b65e57-f482-4c30-9bdd-e9f9eda2976d tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53d275b44a2432a9fe8611304bcfa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d998735c243c3bcd08ca2e2d81ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:10.331022 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-a1b65e57-f482-4c30-9bdd-e9f9eda2976d tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "GET /compute/v2.1/servers/929d6445-681f-48b3-b51f-495532864e64" status: 200 len: 1318 microversion: 2.1 time: 0.222114 Sep 01 14:11:10.332325 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 326/667] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:10 2022] GET /compute/v2.1/servers/929d6445-681f-48b3-b51f-495532864e64 => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:10.423543 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-1a384c50-57eb-46a4-8e8c-a2e6964ba831 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:10.426023 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-1a384c50-57eb-46a4-8e8c-a2e6964ba831 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:10.433858 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1a384c50-57eb-46a4-8e8c-a2e6964ba831 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:10.434806 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1a384c50-57eb-46a4-8e8c-a2e6964ba831 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:10.435535 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1a384c50-57eb-46a4-8e8c-a2e6964ba831 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:10.436439 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1a384c50-57eb-46a4-8e8c-a2e6964ba831 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:10.437026 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1a384c50-57eb-46a4-8e8c-a2e6964ba831 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:10.437591 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1a384c50-57eb-46a4-8e8c-a2e6964ba831 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:10.465967 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-cbf43860-25ea-4f6d-86bc-403114ccbf75 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:10.467423 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-cbf43860-25ea-4f6d-86bc-403114ccbf75 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 91814986-adf4-46cb-8edf-820106d37ecb] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:10.480090 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-cbf43860-25ea-4f6d-86bc-403114ccbf75 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:10.481540 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-cbf43860-25ea-4f6d-86bc-403114ccbf75 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:10.482793 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-cbf43860-25ea-4f6d-86bc-403114ccbf75 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:10.484419 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-cbf43860-25ea-4f6d-86bc-403114ccbf75 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:10.485585 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-cbf43860-25ea-4f6d-86bc-403114ccbf75 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:10.486415 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-cbf43860-25ea-4f6d-86bc-403114ccbf75 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:11.105087 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-1a384c50-57eb-46a4-8e8c-a2e6964ba831 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:11.117572 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-1a384c50-57eb-46a4-8e8c-a2e6964ba831 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1714 microversion: 2.1 time: 0.698889 Sep 01 14:11:11.118937 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 342/668] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:10 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1714 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:11.125304 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [req-86aa63e4-7b1a-4cd3-b313-7a1502d65332 req-197fb273-57ed-41f0-93d3-6408a6d4d67d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1", "name": "network-vif-plugged", "status": "completed", "tag": "214b6ab8-206c-4129-a639-f69abbdaa49b"}]} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:11:11.143031 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-86aa63e4-7b1a-4cd3-b313-7a1502d65332 req-197fb273-57ed-41f0-93d3-6408a6d4d67d service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:11.144165 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-86aa63e4-7b1a-4cd3-b313-7a1502d65332 req-197fb273-57ed-41f0-93d3-6408a6d4d67d service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:11.145077 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-86aa63e4-7b1a-4cd3-b313-7a1502d65332 req-197fb273-57ed-41f0-93d3-6408a6d4d67d service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:11.168336 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.compute.server_external_events [req-86aa63e4-7b1a-4cd3-b313-7a1502d65332 req-197fb273-57ed-41f0-93d3-6408a6d4d67d service nova] Creating event network-vif-plugged:214b6ab8-206c-4129-a639-f69abbdaa49b for instance d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 on hv-cinder-85221 Sep 01 14:11:11.177305 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [req-86aa63e4-7b1a-4cd3-b313-7a1502d65332 req-197fb273-57ed-41f0-93d3-6408a6d4d67d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055987 Sep 01 14:11:11.179086 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 343/669] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:11:11.189448 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-26516bb2-eee9-41d5-a490-dcce5a851989 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:11.190843 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-26516bb2-eee9-41d5-a490-dcce5a851989 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:11.192927 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-cbf43860-25ea-4f6d-86bc-403114ccbf75 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:11.204701 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-26516bb2-eee9-41d5-a490-dcce5a851989 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:11.205624 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-26516bb2-eee9-41d5-a490-dcce5a851989 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:11.206515 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-26516bb2-eee9-41d5-a490-dcce5a851989 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:11.208068 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-26516bb2-eee9-41d5-a490-dcce5a851989 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:11.209034 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-26516bb2-eee9-41d5-a490-dcce5a851989 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:11.209740 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-26516bb2-eee9-41d5-a490-dcce5a851989 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:11.211087 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-cbf43860-25ea-4f6d-86bc-403114ccbf75 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb" status: 200 len: 1684 microversion: 2.1 time: 0.753250 Sep 01 14:11:11.213158 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 327/670] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:10 2022] GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb => generated 1684 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:11.249207 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-934192c4-e284-4387-876a-74692fe9b5eb tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:11.250082 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-934192c4-e284-4387-876a-74692fe9b5eb tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:11.261091 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-934192c4-e284-4387-876a-74692fe9b5eb tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:11.261914 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-934192c4-e284-4387-876a-74692fe9b5eb tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:11.263063 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-934192c4-e284-4387-876a-74692fe9b5eb tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:11.264242 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-934192c4-e284-4387-876a-74692fe9b5eb tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:11.265033 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-934192c4-e284-4387-876a-74692fe9b5eb tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:11.265741 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-934192c4-e284-4387-876a-74692fe9b5eb tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:11.386284 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.wsgi [None req-934192c4-e284-4387-876a-74692fe9b5eb tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] HTTP exception thrown: Cannot 'detach_volume' instance 1988647a-695e-49b8-a5d3-dd6c93c10ae5 while it is in vm_state rescued Sep 01 14:11:11.388528 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-934192c4-e284-4387-876a-74692fe9b5eb tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Request method failure captured: Sep 01 14:11:11.388528 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: request: DELETE /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5/os-volume_attachments/69297810-f373-4ebd-8c92-aca5c1c0ef59 HTTP/1.1 Sep 01 14:11:11.388528 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept: application/json Sep 01 14:11:11.388528 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept-Encoding: identity Sep 01 14:11:11.388528 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Connection: close Sep 01 14:11:11.388528 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Length: 0 Sep 01 14:11:11.388528 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Type: application/json Sep 01 14:11:11.388528 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Host: 10.222.0.25 Sep 01 14:11:11.388528 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Openstack-System-Scope: None Sep 01 14:11:11.388528 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: User-Agent: python-urllib3/1.26.12 Sep 01 14:11:11.388528 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Auth-Token: gAAAAABjELxNSn4EzJ0vI_pvxfL9hGqrffkkfs5u7M-T-ZaLF_wq7SVdY_htuaEWbVmy9Lvl0CF1D_LFwelOxAi92tddj_IJnalwYlx7xPOW4n4bgS9gHt9DKo6_AsO5Qtp2tceRb-kv99jz0XhNuJDrlowBE-mVHlpHgp4Gba56rctae9kot8o Sep 01 14:11:11.388528 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Id: None Sep 01 14:11:11.388528 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Name: None Sep 01 14:11:11.388528 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Identity-Status: Confirmed Sep 01 14:11:11.388528 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Is-Admin-Project: True Sep 01 14:11:11.388528 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Id: default Sep 01 14:11:11.388528 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Name: Default Sep 01 14:11:11.388528 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Id: 36049d2090b84443a3bf3bf00558379e Sep 01 14:11:11.388528 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-697169282 Sep 01 14:11:11.388528 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Role: member,reader Sep 01 14:11:11.388528 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Roles: member,reader Sep 01 14:11:11.393032 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/36049d2090b84443a3bf3bf00558379e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/36049d2090b84443a3bf3bf00558379e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/36049d2090b84443a3bf3bf00558379e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_36049d2090b84443a3bf3bf00558379e"}]}] Sep 01 14:11:11.393032 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant: tempest-ServerRescueNegativeTestJSON-697169282 Sep 01 14:11:11.393032 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Id: 36049d2090b84443a3bf3bf00558379e Sep 01 14:11:11.393032 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-697169282 Sep 01 14:11:11.393032 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User: tempest-ServerRescueNegativeTestJSON-697169282-project Sep 01 14:11:11.393032 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Id: default Sep 01 14:11:11.393032 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Name: Default Sep 01 14:11:11.393032 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Id: 7562a0429fdf42948174b517b211884f Sep 01 14:11:11.393032 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Name: tempest-ServerRescueNegativeTestJSON-697169282-project Sep 01 14:11:11.393032 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: method: > Sep 01 14:11:11.393032 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: exception: Cannot 'detach_volume' instance 1988647a-695e-49b8-a5d3-dd6c93c10ae5 while it is in vm_state rescued Sep 01 14:11:11.394841 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: action_args: {'server_id': '1988647a-695e-49b8-a5d3-dd6c93c10ae5', 'id': '69297810-f373-4ebd-8c92-aca5c1c0ef59'} Sep 01 14:11:11.394841 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:11:11.394841 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:11:11.394841 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 01 14:11:11.394841 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 01 14:11:11.394841 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 14:11:11.394841 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 14:11:11.394841 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 01 14:11:11.394841 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 01 14:11:11.394841 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1988647a-695e-49b8-a5d3-dd6c93c10ae5 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 01 14:11:11.394841 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:11:11.394841 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:11:11.394841 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:11:11.394841 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:11:11.394841 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:11:11.394841 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:11:11.394841 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:11:11.394841 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:11:11.394841 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:11:11.394841 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:11:11.397334 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 01 14:11:11.397334 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 01 14:11:11.397334 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 01 14:11:11.397334 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 01 14:11:11.397334 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 1988647a-695e-49b8-a5d3-dd6c93c10ae5 while it is in vm_state rescued Sep 01 14:11:11.397334 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:11:11.397334 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:11:11.397334 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:11:11.397334 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:11:11.397334 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:11:11.397334 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:11:11.397334 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:11:11.397334 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:11:11.397334 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 1988647a-695e-49b8-a5d3-dd6c93c10ae5 while it is in vm_state rescued Sep 01 14:11:11.397334 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:11:11.397334 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-934192c4-e284-4387-876a-74692fe9b5eb tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Returning 409 to user: Cannot 'detach_volume' instance 1988647a-695e-49b8-a5d3-dd6c93c10ae5 while it is in vm_state rescued {{(pid=121339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:11:11.399348 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-934192c4-e284-4387-876a-74692fe9b5eb tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5/os-volume_attachments/69297810-f373-4ebd-8c92-aca5c1c0ef59" status: 409 len: 152 microversion: 2.1 time: 0.155055 Sep 01 14:11:11.399348 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 328/671] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Sep 1 14:11:11 2022] DELETE /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5/os-volume_attachments/69297810-f373-4ebd-8c92-aca5c1c0ef59 => generated 152 bytes in 158 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 01 14:11:11.401351 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-5231a307-17fa-40d5-ba85-a0d55be5ae8a tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:11.402171 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-5231a307-17fa-40d5-ba85-a0d55be5ae8a tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 929d6445-681f-48b3-b51f-495532864e64] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:11.411571 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5231a307-17fa-40d5-ba85-a0d55be5ae8a tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:11.412302 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5231a307-17fa-40d5-ba85-a0d55be5ae8a tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:11.412841 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5231a307-17fa-40d5-ba85-a0d55be5ae8a tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:11.413705 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5231a307-17fa-40d5-ba85-a0d55be5ae8a tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:11.414313 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5231a307-17fa-40d5-ba85-a0d55be5ae8a tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:11.414931 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5231a307-17fa-40d5-ba85-a0d55be5ae8a tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:11.431507 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-26516bb2-eee9-41d5-a490-dcce5a851989 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:11.443735 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-26516bb2-eee9-41d5-a490-dcce5a851989 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:11.445419 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-26516bb2-eee9-41d5-a490-dcce5a851989 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:11.446894 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-26516bb2-eee9-41d5-a490-dcce5a851989 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1406 microversion: 2.20 time: 0.265992 Sep 01 14:11:11.447552 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 344/672] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:11:11 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1406 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:11:11.453176 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-8b736bd2-e0c3-428e-9987-58ae5733a117 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:11:11.454759 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-8b736bd2-e0c3-428e-9987-58ae5733a117 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:11.463390 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8b736bd2-e0c3-428e-9987-58ae5733a117 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:11.464235 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8b736bd2-e0c3-428e-9987-58ae5733a117 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:11.464809 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8b736bd2-e0c3-428e-9987-58ae5733a117 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:11.465971 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8b736bd2-e0c3-428e-9987-58ae5733a117 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:11.466780 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8b736bd2-e0c3-428e-9987-58ae5733a117 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:11.467542 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8b736bd2-e0c3-428e-9987-58ae5733a117 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:11.656134 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-5231a307-17fa-40d5-ba85-a0d55be5ae8a tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53d275b44a2432a9fe8611304bcfa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d998735c243c3bcd08ca2e2d81ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:11.666334 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-5231a307-17fa-40d5-ba85-a0d55be5ae8a tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "GET /compute/v2.1/servers/929d6445-681f-48b3-b51f-495532864e64" status: 200 len: 1508 microversion: 2.1 time: 0.271260 Sep 01 14:11:11.667168 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 329/673] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:11 2022] GET /compute/v2.1/servers/929d6445-681f-48b3-b51f-495532864e64 => generated 1508 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:11.689704 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-8e38cca1-a1e3-4459-aea3-4d4a6156bc1f tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ca2ff44-c2bf-417d-95c9-b1973c25ac97", "device": "/dev/sdb"}} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:11:11.692306 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-8e38cca1-a1e3-4459-aea3-4d4a6156bc1f tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 929d6445-681f-48b3-b51f-495532864e64] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:11.699032 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8e38cca1-a1e3-4459-aea3-4d4a6156bc1f tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:11.699604 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8e38cca1-a1e3-4459-aea3-4d4a6156bc1f tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:11.700106 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8e38cca1-a1e3-4459-aea3-4d4a6156bc1f tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:11.700891 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8e38cca1-a1e3-4459-aea3-4d4a6156bc1f tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:11.701550 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8e38cca1-a1e3-4459-aea3-4d4a6156bc1f tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:11.702108 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8e38cca1-a1e3-4459-aea3-4d4a6156bc1f tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:11.790516 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:11:11.791126 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-8b736bd2-e0c3-428e-9987-58ae5733a117 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "POST /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5/action" status: 202 len: 0 microversion: 2.1 time: 0.342089 Sep 01 14:11:11.791959 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 345/674] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Sep 1 14:11:11 2022] POST /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5/action => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:11:11.805022 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-a634386b-8f0a-4968-af55-42a96c05fe58 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:11.806091 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-a634386b-8f0a-4968-af55-42a96c05fe58 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:11.814146 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a634386b-8f0a-4968-af55-42a96c05fe58 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:11.814517 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a634386b-8f0a-4968-af55-42a96c05fe58 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:11.814947 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a634386b-8f0a-4968-af55-42a96c05fe58 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:11.815666 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a634386b-8f0a-4968-af55-42a96c05fe58 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:11.816118 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a634386b-8f0a-4968-af55-42a96c05fe58 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:11.816543 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a634386b-8f0a-4968-af55-42a96c05fe58 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:11.982485 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-a634386b-8f0a-4968-af55-42a96c05fe58 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:11.992922 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-a634386b-8f0a-4968-af55-42a96c05fe58 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1722 microversion: 2.1 time: 0.193710 Sep 01 14:11:11.993585 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 346/675] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:11 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:11:12.256336 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-f51fe0be-d204-4a3e-ab30-420793597d16 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:12.257443 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-f51fe0be-d204-4a3e-ab30-420793597d16 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 91814986-adf4-46cb-8edf-820106d37ecb] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:12.266994 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f51fe0be-d204-4a3e-ab30-420793597d16 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:12.267820 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f51fe0be-d204-4a3e-ab30-420793597d16 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:12.268770 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f51fe0be-d204-4a3e-ab30-420793597d16 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:12.270153 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f51fe0be-d204-4a3e-ab30-420793597d16 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:12.271041 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f51fe0be-d204-4a3e-ab30-420793597d16 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:12.271796 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f51fe0be-d204-4a3e-ab30-420793597d16 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:12.576544 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-f51fe0be-d204-4a3e-ab30-420793597d16 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:12.581389 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:11:12.599043 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-f51fe0be-d204-4a3e-ab30-420793597d16 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb" status: 200 len: 1684 microversion: 2.1 time: 0.350664 Sep 01 14:11:12.624632 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 347/676] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:12 2022] GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb => generated 1684 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:12.646031 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-04ff30cb-0500-4a7a-85fd-ac6a2ab7f350 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:12.647906 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-04ff30cb-0500-4a7a-85fd-ac6a2ab7f350 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:12.663366 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-04ff30cb-0500-4a7a-85fd-ac6a2ab7f350 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:12.664308 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-04ff30cb-0500-4a7a-85fd-ac6a2ab7f350 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:12.665094 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-04ff30cb-0500-4a7a-85fd-ac6a2ab7f350 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:12.666676 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-04ff30cb-0500-4a7a-85fd-ac6a2ab7f350 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:12.667774 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-04ff30cb-0500-4a7a-85fd-ac6a2ab7f350 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:12.668564 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-04ff30cb-0500-4a7a-85fd-ac6a2ab7f350 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:13.193006 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-04ff30cb-0500-4a7a-85fd-ac6a2ab7f350 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:13.202381 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-04ff30cb-0500-4a7a-85fd-ac6a2ab7f350 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:13.209524 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-04ff30cb-0500-4a7a-85fd-ac6a2ab7f350 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:13.210879 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-04ff30cb-0500-4a7a-85fd-ac6a2ab7f350 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1406 microversion: 2.20 time: 0.592549 Sep 01 14:11:13.222253 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 348/677] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:11:12 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1406 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:11:13.228159 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-8e38cca1-a1e3-4459-aea3-4d4a6156bc1f tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "POST /compute/v2.1/servers/929d6445-681f-48b3-b51f-495532864e64/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.537883 Sep 01 14:11:13.230396 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 330/678] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Sep 1 14:11:11 2022] POST /compute/v2.1/servers/929d6445-681f-48b3-b51f-495532864e64/os-volume_attachments => generated 194 bytes in 1546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:11:13.232171 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-ee72a11e-3bef-497c-83dc-e2721454d98e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:13.233078 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-ee72a11e-3bef-497c-83dc-e2721454d98e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:13.245659 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ee72a11e-3bef-497c-83dc-e2721454d98e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:13.246860 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ee72a11e-3bef-497c-83dc-e2721454d98e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:13.247668 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ee72a11e-3bef-497c-83dc-e2721454d98e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:13.248944 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ee72a11e-3bef-497c-83dc-e2721454d98e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:13.250005 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ee72a11e-3bef-497c-83dc-e2721454d98e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:13.251030 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ee72a11e-3bef-497c-83dc-e2721454d98e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:13.482200 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-ee72a11e-3bef-497c-83dc-e2721454d98e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:13.493391 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-ee72a11e-3bef-497c-83dc-e2721454d98e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1722 microversion: 2.1 time: 0.268952 Sep 01 14:11:13.494086 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 349/679] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:13 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1722 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:13.650055 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-59bd4e82-c317-4a03-8dd3-3ccc43740f4f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:13.650933 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-59bd4e82-c317-4a03-8dd3-3ccc43740f4f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 91814986-adf4-46cb-8edf-820106d37ecb] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:13.667561 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-59bd4e82-c317-4a03-8dd3-3ccc43740f4f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:13.670623 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-59bd4e82-c317-4a03-8dd3-3ccc43740f4f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:13.672097 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-59bd4e82-c317-4a03-8dd3-3ccc43740f4f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:13.678811 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-59bd4e82-c317-4a03-8dd3-3ccc43740f4f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:13.678811 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-59bd4e82-c317-4a03-8dd3-3ccc43740f4f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:13.678811 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-59bd4e82-c317-4a03-8dd3-3ccc43740f4f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:13.759230 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-59bd4e82-c317-4a03-8dd3-3ccc43740f4f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:13.769574 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-59bd4e82-c317-4a03-8dd3-3ccc43740f4f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb" status: 200 len: 1616 microversion: 2.1 time: 0.132663 Sep 01 14:11:13.770391 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 331/680] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:13 2022] GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb => generated 1616 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:14.047214 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [req-4e195d69-1ed8-461c-b28a-c4f7cf23afde req-4d72320e-b6f9-4129-9079-16dfa163baa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91814986-adf4-46cb-8edf-820106d37ecb", "name": "network-vif-deleted", "tag": "e0564e10-4a1c-482b-8355-e8813807b5bd"}]} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:11:14.068984 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-4e195d69-1ed8-461c-b28a-c4f7cf23afde req-4d72320e-b6f9-4129-9079-16dfa163baa3 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:14.069703 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-4e195d69-1ed8-461c-b28a-c4f7cf23afde req-4d72320e-b6f9-4129-9079-16dfa163baa3 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:14.070294 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-4e195d69-1ed8-461c-b28a-c4f7cf23afde req-4d72320e-b6f9-4129-9079-16dfa163baa3 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:14.087087 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.compute.server_external_events [req-4e195d69-1ed8-461c-b28a-c4f7cf23afde req-4d72320e-b6f9-4129-9079-16dfa163baa3 service nova] Creating event network-vif-deleted:e0564e10-4a1c-482b-8355-e8813807b5bd for instance 91814986-adf4-46cb-8edf-820106d37ecb on hv-cinder-85221 Sep 01 14:11:14.094333 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [req-4e195d69-1ed8-461c-b28a-c4f7cf23afde req-4d72320e-b6f9-4129-9079-16dfa163baa3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055249 Sep 01 14:11:14.095213 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 350/681] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:11:14.238391 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-545d1eed-4b85-4a4b-ab4b-a714070aedc8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:14.240375 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-545d1eed-4b85-4a4b-ab4b-a714070aedc8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:14.251804 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-545d1eed-4b85-4a4b-ab4b-a714070aedc8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:14.252988 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-545d1eed-4b85-4a4b-ab4b-a714070aedc8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:14.254014 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-545d1eed-4b85-4a4b-ab4b-a714070aedc8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:14.255466 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-545d1eed-4b85-4a4b-ab4b-a714070aedc8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:14.256515 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-545d1eed-4b85-4a4b-ab4b-a714070aedc8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:14.260651 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-545d1eed-4b85-4a4b-ab4b-a714070aedc8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:14.496088 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-545d1eed-4b85-4a4b-ab4b-a714070aedc8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:14.507721 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-545d1eed-4b85-4a4b-ab4b-a714070aedc8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:14.509829 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-545d1eed-4b85-4a4b-ab4b-a714070aedc8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:14.511945 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-545d1eed-4b85-4a4b-ab4b-a714070aedc8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1406 microversion: 2.20 time: 0.280161 Sep 01 14:11:14.513003 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 332/682] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:11:14 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1406 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:11:14.523687 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-4ba51f7d-c40d-4ed1-a8f1-160783a1e178 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:14.525072 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-4ba51f7d-c40d-4ed1-a8f1-160783a1e178 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:14.538440 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4ba51f7d-c40d-4ed1-a8f1-160783a1e178 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:14.539171 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4ba51f7d-c40d-4ed1-a8f1-160783a1e178 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:14.539954 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4ba51f7d-c40d-4ed1-a8f1-160783a1e178 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:14.541207 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4ba51f7d-c40d-4ed1-a8f1-160783a1e178 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:14.542071 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4ba51f7d-c40d-4ed1-a8f1-160783a1e178 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:14.542832 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4ba51f7d-c40d-4ed1-a8f1-160783a1e178 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:14.793217 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-142d8dcc-5ab5-4a98-bd9b-660a5f35a03a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:14.794491 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-142d8dcc-5ab5-4a98-bd9b-660a5f35a03a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 91814986-adf4-46cb-8edf-820106d37ecb] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:14.803356 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-142d8dcc-5ab5-4a98-bd9b-660a5f35a03a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:14.804321 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-142d8dcc-5ab5-4a98-bd9b-660a5f35a03a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:14.805109 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-142d8dcc-5ab5-4a98-bd9b-660a5f35a03a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:14.806293 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-4ba51f7d-c40d-4ed1-a8f1-160783a1e178 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:14.806533 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-142d8dcc-5ab5-4a98-bd9b-660a5f35a03a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:14.807380 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-142d8dcc-5ab5-4a98-bd9b-660a5f35a03a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:14.808314 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-142d8dcc-5ab5-4a98-bd9b-660a5f35a03a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:14.823900 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-4ba51f7d-c40d-4ed1-a8f1-160783a1e178 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1722 microversion: 2.1 time: 0.308436 Sep 01 14:11:14.825671 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 351/683] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:14 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1722 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:14.868775 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-142d8dcc-5ab5-4a98-bd9b-660a5f35a03a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:14.869826 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-142d8dcc-5ab5-4a98-bd9b-660a5f35a03a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:14.870427 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-142d8dcc-5ab5-4a98-bd9b-660a5f35a03a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:14.871121 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.objects.instance [None req-142d8dcc-5ab5-4a98-bd9b-660a5f35a03a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lazy-loading 'fault' on Instance uuid 91814986-adf4-46cb-8edf-820106d37ecb {{(pid=121339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:11:14.933489 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-142d8dcc-5ab5-4a98-bd9b-660a5f35a03a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:14.943073 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-142d8dcc-5ab5-4a98-bd9b-660a5f35a03a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb" status: 200 len: 1332 microversion: 2.1 time: 0.155085 Sep 01 14:11:14.943667 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 333/684] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:14 2022] GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb => generated 1332 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:11:15.546877 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-b7e61828-af46-46e7-abea-9a5ebd58c1e5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:15.547745 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-b7e61828-af46-46e7-abea-9a5ebd58c1e5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:15.555183 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b7e61828-af46-46e7-abea-9a5ebd58c1e5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:15.555846 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b7e61828-af46-46e7-abea-9a5ebd58c1e5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:15.556362 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b7e61828-af46-46e7-abea-9a5ebd58c1e5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:15.557275 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b7e61828-af46-46e7-abea-9a5ebd58c1e5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:15.557828 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b7e61828-af46-46e7-abea-9a5ebd58c1e5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:15.558368 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b7e61828-af46-46e7-abea-9a5ebd58c1e5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:15.720012 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-b7e61828-af46-46e7-abea-9a5ebd58c1e5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:15.731721 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-b7e61828-af46-46e7-abea-9a5ebd58c1e5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:15.733281 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-b7e61828-af46-46e7-abea-9a5ebd58c1e5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:15.734540 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-b7e61828-af46-46e7-abea-9a5ebd58c1e5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1598 microversion: 2.20 time: 0.191767 Sep 01 14:11:15.735910 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 352/685] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:11:15 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1598 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:11:15.759583 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-e00124a9-f5b8-45b0-b019-c4ef15f0a281 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:15.760140 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-e00124a9-f5b8-45b0-b019-c4ef15f0a281 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:15.766578 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e00124a9-f5b8-45b0-b019-c4ef15f0a281 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:15.767077 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e00124a9-f5b8-45b0-b019-c4ef15f0a281 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:15.767511 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e00124a9-f5b8-45b0-b019-c4ef15f0a281 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:15.768231 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e00124a9-f5b8-45b0-b019-c4ef15f0a281 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:15.768681 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e00124a9-f5b8-45b0-b019-c4ef15f0a281 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:15.769096 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e00124a9-f5b8-45b0-b019-c4ef15f0a281 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:15.856228 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-e00124a9-f5b8-45b0-b019-c4ef15f0a281 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.100750 Sep 01 14:11:15.856992 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 334/686] 10.222.0.25 () {60 vars in 1316 bytes} [Thu Sep 1 14:11:15 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 14:11:15.863151 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-d51dc93b-fff9-427f-aeb1-e3303f684b55 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:15.864386 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-d51dc93b-fff9-427f-aeb1-e3303f684b55 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:15.875888 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d51dc93b-fff9-427f-aeb1-e3303f684b55 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:15.877006 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d51dc93b-fff9-427f-aeb1-e3303f684b55 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:15.877792 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d51dc93b-fff9-427f-aeb1-e3303f684b55 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:15.879215 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d51dc93b-fff9-427f-aeb1-e3303f684b55 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:15.880068 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d51dc93b-fff9-427f-aeb1-e3303f684b55 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:15.880837 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d51dc93b-fff9-427f-aeb1-e3303f684b55 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:15.980825 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-6bc72700-00a3-4173-94e7-79b0dab3ef24 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:15.982107 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-6bc72700-00a3-4173-94e7-79b0dab3ef24 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 91814986-adf4-46cb-8edf-820106d37ecb] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:15.994063 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6bc72700-00a3-4173-94e7-79b0dab3ef24 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:15.995021 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6bc72700-00a3-4173-94e7-79b0dab3ef24 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:15.995881 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6bc72700-00a3-4173-94e7-79b0dab3ef24 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:15.997221 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6bc72700-00a3-4173-94e7-79b0dab3ef24 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:15.998137 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6bc72700-00a3-4173-94e7-79b0dab3ef24 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:15.998958 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6bc72700-00a3-4173-94e7-79b0dab3ef24 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:16.059548 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6bc72700-00a3-4173-94e7-79b0dab3ef24 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:16.060634 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6bc72700-00a3-4173-94e7-79b0dab3ef24 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:16.061410 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6bc72700-00a3-4173-94e7-79b0dab3ef24 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:16.062260 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.objects.instance [None req-6bc72700-00a3-4173-94e7-79b0dab3ef24 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lazy-loading 'fault' on Instance uuid 91814986-adf4-46cb-8edf-820106d37ecb {{(pid=121339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:11:16.142973 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-6bc72700-00a3-4173-94e7-79b0dab3ef24 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:16.156342 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-6bc72700-00a3-4173-94e7-79b0dab3ef24 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb" status: 200 len: 1332 microversion: 2.1 time: 0.182702 Sep 01 14:11:16.177935 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 335/687] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:15 2022] GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb => generated 1332 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:11:16.209722 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-d51dc93b-fff9-427f-aeb1-e3303f684b55 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:16.219254 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-d51dc93b-fff9-427f-aeb1-e3303f684b55 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1722 microversion: 2.1 time: 0.364376 Sep 01 14:11:16.221263 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 353/688] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:15 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1722 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:11:17.193647 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-bfd90865-fa69-4c32-a4d0-95c40a399885 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:17.194379 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-bfd90865-fa69-4c32-a4d0-95c40a399885 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 91814986-adf4-46cb-8edf-820106d37ecb] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:17.203473 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-bfd90865-fa69-4c32-a4d0-95c40a399885 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:17.204875 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-bfd90865-fa69-4c32-a4d0-95c40a399885 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:17.205875 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-bfd90865-fa69-4c32-a4d0-95c40a399885 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:17.206682 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-bfd90865-fa69-4c32-a4d0-95c40a399885 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:17.207149 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-bfd90865-fa69-4c32-a4d0-95c40a399885 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:17.208438 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-bfd90865-fa69-4c32-a4d0-95c40a399885 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:17.231422 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [req-10baff35-76cd-40d5-aa11-85e64177af91 req-443fd567-9c4d-42e6-8bc7-32613c59f950 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1", "tag": "214b6ab8-206c-4129-a639-f69abbdaa49b"}]} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:11:17.249413 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-10baff35-76cd-40d5-aa11-85e64177af91 req-443fd567-9c4d-42e6-8bc7-32613c59f950 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:17.250386 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-bfd90865-fa69-4c32-a4d0-95c40a399885 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:17.251416 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-bfd90865-fa69-4c32-a4d0-95c40a399885 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:17.251566 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-10baff35-76cd-40d5-aa11-85e64177af91 req-443fd567-9c4d-42e6-8bc7-32613c59f950 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:17.251858 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-bfd90865-fa69-4c32-a4d0-95c40a399885 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:17.252325 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.objects.instance [None req-bfd90865-fa69-4c32-a4d0-95c40a399885 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lazy-loading 'fault' on Instance uuid 91814986-adf4-46cb-8edf-820106d37ecb {{(pid=121339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:11:17.253171 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-10baff35-76cd-40d5-aa11-85e64177af91 req-443fd567-9c4d-42e6-8bc7-32613c59f950 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:17.276890 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.compute.server_external_events [req-10baff35-76cd-40d5-aa11-85e64177af91 req-443fd567-9c4d-42e6-8bc7-32613c59f950 service nova] Creating event network-changed:214b6ab8-206c-4129-a639-f69abbdaa49b for instance d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 on hv-cinder-85221 Sep 01 14:11:17.287535 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [req-10baff35-76cd-40d5-aa11-85e64177af91 req-443fd567-9c4d-42e6-8bc7-32613c59f950 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062436 Sep 01 14:11:17.288831 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 354/689] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:11:17.301031 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-60c383cb-e0a9-4581-9362-5bc3025f8804 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:17.302449 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-60c383cb-e0a9-4581-9362-5bc3025f8804 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:17.305936 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-bfd90865-fa69-4c32-a4d0-95c40a399885 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:17.315257 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-bfd90865-fa69-4c32-a4d0-95c40a399885 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb" status: 200 len: 1332 microversion: 2.1 time: 0.127504 Sep 01 14:11:17.315812 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-60c383cb-e0a9-4581-9362-5bc3025f8804 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:17.317754 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-60c383cb-e0a9-4581-9362-5bc3025f8804 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:17.318681 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-60c383cb-e0a9-4581-9362-5bc3025f8804 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:17.320395 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-60c383cb-e0a9-4581-9362-5bc3025f8804 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:17.321299 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-60c383cb-e0a9-4581-9362-5bc3025f8804 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:17.322194 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-60c383cb-e0a9-4581-9362-5bc3025f8804 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:17.322755 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 336/690] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:17 2022] GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb => generated 1332 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:11:17.547446 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-60c383cb-e0a9-4581-9362-5bc3025f8804 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:17.557711 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-60c383cb-e0a9-4581-9362-5bc3025f8804 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1722 microversion: 2.1 time: 0.266783 Sep 01 14:11:17.558362 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 355/691] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:17 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1722 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:18.053120 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-52a7e34f-4150-4be0-8be7-96a13bb89d5c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:18.057272 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-52a7e34f-4150-4be0-8be7-96a13bb89d5c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:18.068968 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-52a7e34f-4150-4be0-8be7-96a13bb89d5c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:18.069855 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-52a7e34f-4150-4be0-8be7-96a13bb89d5c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:18.070670 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-52a7e34f-4150-4be0-8be7-96a13bb89d5c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:18.071969 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-52a7e34f-4150-4be0-8be7-96a13bb89d5c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:18.072795 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-52a7e34f-4150-4be0-8be7-96a13bb89d5c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:18.073567 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-52a7e34f-4150-4be0-8be7-96a13bb89d5c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:18.133148 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-52a7e34f-4150-4be0-8be7-96a13bb89d5c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.086968 Sep 01 14:11:18.133698 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 337/692] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 14:11:18 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7/os-volume_attachments => generated 25 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 14:11:18.208163 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-8000c35f-08b9-4de2-8c78-7ae7e22d4534 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:18.208672 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-8000c35f-08b9-4de2-8c78-7ae7e22d4534 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:18.221285 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8000c35f-08b9-4de2-8c78-7ae7e22d4534 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:18.222617 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8000c35f-08b9-4de2-8c78-7ae7e22d4534 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:18.224535 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8000c35f-08b9-4de2-8c78-7ae7e22d4534 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:18.225840 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8000c35f-08b9-4de2-8c78-7ae7e22d4534 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:18.226943 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8000c35f-08b9-4de2-8c78-7ae7e22d4534 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:18.236877 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8000c35f-08b9-4de2-8c78-7ae7e22d4534 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:18.280795 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-8000c35f-08b9-4de2-8c78-7ae7e22d4534 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Going to try to terminate instance {{(pid=121340) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:11:18.339971 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-a8abec5b-2d35-4c5f-87c7-894b44652b48 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:18.341950 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-a8abec5b-2d35-4c5f-87c7-894b44652b48 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 91814986-adf4-46cb-8edf-820106d37ecb] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:18.353984 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a8abec5b-2d35-4c5f-87c7-894b44652b48 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:18.354863 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a8abec5b-2d35-4c5f-87c7-894b44652b48 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:18.355926 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a8abec5b-2d35-4c5f-87c7-894b44652b48 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:18.357540 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a8abec5b-2d35-4c5f-87c7-894b44652b48 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:18.358615 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a8abec5b-2d35-4c5f-87c7-894b44652b48 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:18.359611 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a8abec5b-2d35-4c5f-87c7-894b44652b48 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:18.421978 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a8abec5b-2d35-4c5f-87c7-894b44652b48 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:18.423463 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a8abec5b-2d35-4c5f-87c7-894b44652b48 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:18.424157 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a8abec5b-2d35-4c5f-87c7-894b44652b48 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:18.424786 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.objects.instance [None req-a8abec5b-2d35-4c5f-87c7-894b44652b48 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lazy-loading 'fault' on Instance uuid 91814986-adf4-46cb-8edf-820106d37ecb {{(pid=121339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:11:18.501241 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-a8abec5b-2d35-4c5f-87c7-894b44652b48 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:18.514743 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-a8abec5b-2d35-4c5f-87c7-894b44652b48 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb" status: 200 len: 1332 microversion: 2.1 time: 0.181458 Sep 01 14:11:18.521950 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 338/693] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:18 2022] GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb => generated 1332 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:11:18.612856 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-e06f1063-331b-4c53-b996-8b0dff96de1a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:18.613847 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-e06f1063-331b-4c53-b996-8b0dff96de1a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:18.621623 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e06f1063-331b-4c53-b996-8b0dff96de1a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:18.622456 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e06f1063-331b-4c53-b996-8b0dff96de1a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:18.623134 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e06f1063-331b-4c53-b996-8b0dff96de1a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:18.624666 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e06f1063-331b-4c53-b996-8b0dff96de1a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:18.626289 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e06f1063-331b-4c53-b996-8b0dff96de1a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:18.626916 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e06f1063-331b-4c53-b996-8b0dff96de1a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:18.803233 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-8000c35f-08b9-4de2-8c78-7ae7e22d4534 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 204 len: 0 microversion: 2.1 time: 0.599936 Sep 01 14:11:18.804356 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 356/694] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 14:11:18 2022] DELETE /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:11:18.814526 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-e5b9a0c7-d897-4c11-9c6a-3849f6f8ac2d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:18.815241 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-e5b9a0c7-d897-4c11-9c6a-3849f6f8ac2d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:18.823451 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e5b9a0c7-d897-4c11-9c6a-3849f6f8ac2d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:18.824536 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e5b9a0c7-d897-4c11-9c6a-3849f6f8ac2d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:18.825097 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e5b9a0c7-d897-4c11-9c6a-3849f6f8ac2d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:18.826251 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e5b9a0c7-d897-4c11-9c6a-3849f6f8ac2d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:18.826864 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e5b9a0c7-d897-4c11-9c6a-3849f6f8ac2d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:18.827410 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e5b9a0c7-d897-4c11-9c6a-3849f6f8ac2d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:18.929842 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-e06f1063-331b-4c53-b996-8b0dff96de1a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:18.943768 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-e06f1063-331b-4c53-b996-8b0dff96de1a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1728 microversion: 2.1 time: 0.347665 Sep 01 14:11:18.944485 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 339/695] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:18 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1728 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:18.981058 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-282eacd3-d58d-4a0c-9f19-c8f434c6e789 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:18.991935 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-282eacd3-d58d-4a0c-9f19-c8f434c6e789 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:18.991935 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-282eacd3-d58d-4a0c-9f19-c8f434c6e789 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:18.992302 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-282eacd3-d58d-4a0c-9f19-c8f434c6e789 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:18.992882 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-282eacd3-d58d-4a0c-9f19-c8f434c6e789 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:18.993865 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-282eacd3-d58d-4a0c-9f19-c8f434c6e789 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:18.994567 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-282eacd3-d58d-4a0c-9f19-c8f434c6e789 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:18.995197 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-282eacd3-d58d-4a0c-9f19-c8f434c6e789 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:19.027808 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-e5b9a0c7-d897-4c11-9c6a-3849f6f8ac2d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:19.036921 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-e5b9a0c7-d897-4c11-9c6a-3849f6f8ac2d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1674 microversion: 2.1 time: 0.227409 Sep 01 14:11:19.037518 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 357/696] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:18 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1674 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:19.082185 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-282eacd3-d58d-4a0c-9f19-c8f434c6e789 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105677 Sep 01 14:11:19.085976 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 340/697] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Sep 1 14:11:18 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:11:19.133084 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-a0bd7001-eeee-4a06-aa95-3f2d3f8ade7e tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:11:19.135875 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-a0bd7001-eeee-4a06-aa95-3f2d3f8ade7e tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:19.144248 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a0bd7001-eeee-4a06-aa95-3f2d3f8ade7e tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:19.145137 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a0bd7001-eeee-4a06-aa95-3f2d3f8ade7e tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:19.145583 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a0bd7001-eeee-4a06-aa95-3f2d3f8ade7e tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:19.146553 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a0bd7001-eeee-4a06-aa95-3f2d3f8ade7e tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:19.147002 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a0bd7001-eeee-4a06-aa95-3f2d3f8ade7e tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:19.147435 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a0bd7001-eeee-4a06-aa95-3f2d3f8ade7e tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:19.418471 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-a0bd7001-eeee-4a06-aa95-3f2d3f8ade7e tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "POST /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a/action" status: 202 len: 0 microversion: 2.1 time: 0.289794 Sep 01 14:11:19.419885 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 358/698] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Sep 1 14:11:19 2022] POST /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 14:11:19.430514 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-01097b8d-7e22-403b-ac95-09b10e714753 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:19.431127 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-01097b8d-7e22-403b-ac95-09b10e714753 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:19.438217 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-01097b8d-7e22-403b-ac95-09b10e714753 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:19.438621 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-01097b8d-7e22-403b-ac95-09b10e714753 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:19.439055 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-01097b8d-7e22-403b-ac95-09b10e714753 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:19.439771 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-01097b8d-7e22-403b-ac95-09b10e714753 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:19.440367 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-01097b8d-7e22-403b-ac95-09b10e714753 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:19.440862 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-01097b8d-7e22-403b-ac95-09b10e714753 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:19.549474 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-dd8945cd-814d-4f2a-a1a6-a167ca455739 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:19.550242 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-dd8945cd-814d-4f2a-a1a6-a167ca455739 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 91814986-adf4-46cb-8edf-820106d37ecb] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:19.557782 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-dd8945cd-814d-4f2a-a1a6-a167ca455739 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:19.558293 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-dd8945cd-814d-4f2a-a1a6-a167ca455739 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:19.558736 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-dd8945cd-814d-4f2a-a1a6-a167ca455739 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:19.559536 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-dd8945cd-814d-4f2a-a1a6-a167ca455739 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:19.559999 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-dd8945cd-814d-4f2a-a1a6-a167ca455739 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:19.560424 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-dd8945cd-814d-4f2a-a1a6-a167ca455739 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:19.576584 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.wsgi [None req-dd8945cd-814d-4f2a-a1a6-a167ca455739 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] HTTP exception thrown: Instance 91814986-adf4-46cb-8edf-820106d37ecb could not be found. Sep 01 14:11:19.578297 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-dd8945cd-814d-4f2a-a1a6-a167ca455739 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Request method failure captured: Sep 01 14:11:19.578297 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: request: GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb HTTP/1.1 Sep 01 14:11:19.578297 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept: application/json Sep 01 14:11:19.578297 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept-Encoding: identity Sep 01 14:11:19.578297 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Connection: close Sep 01 14:11:19.578297 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Length: 0 Sep 01 14:11:19.578297 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Type: application/json Sep 01 14:11:19.578297 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Host: 10.222.0.25 Sep 01 14:11:19.578297 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Openstack-System-Scope: None Sep 01 14:11:19.578297 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: User-Agent: python-urllib3/1.26.12 Sep 01 14:11:19.578297 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Auth-Token: gAAAAABjELyhZj5Hr9I4grX9g-sLmSzxOFwV6C8_UuPsJu0TTboeG4lPJ1EtlgmTO6Q18ohdm_zKgQxmrLRlDi5SpU-ZjSVzLIRa5u6LBsCTR0TutJimllLkII0Ts1UxHVT4475s7UI-5uK5aNVzYOSUMxaGRq9ZaCGPwi2wkROzwm6JUQLDfLI Sep 01 14:11:19.578297 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Id: None Sep 01 14:11:19.578297 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Name: None Sep 01 14:11:19.578297 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Identity-Status: Confirmed Sep 01 14:11:19.578297 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Is-Admin-Project: True Sep 01 14:11:19.578297 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Id: default Sep 01 14:11:19.578297 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Name: Default Sep 01 14:11:19.578297 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Id: 90a84500a899479aabfa3aeb72b4c4ae Sep 01 14:11:19.578297 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Name: tempest-AttachVolumeNegativeTest-836381067 Sep 01 14:11:19.578297 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Role: member,reader Sep 01 14:11:19.578297 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Roles: member,reader Sep 01 14:11:19.580696 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/90a84500a899479aabfa3aeb72b4c4ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/90a84500a899479aabfa3aeb72b4c4ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/90a84500a899479aabfa3aeb72b4c4ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_90a84500a899479aabfa3aeb72b4c4ae"}]}] Sep 01 14:11:19.580696 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant: tempest-AttachVolumeNegativeTest-836381067 Sep 01 14:11:19.580696 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Id: 90a84500a899479aabfa3aeb72b4c4ae Sep 01 14:11:19.580696 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-836381067 Sep 01 14:11:19.580696 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User: tempest-AttachVolumeNegativeTest-836381067-project Sep 01 14:11:19.580696 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Id: default Sep 01 14:11:19.580696 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Name: Default Sep 01 14:11:19.580696 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Id: 7ae66df61a764a42a1b1b15f54d5c34b Sep 01 14:11:19.580696 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Name: tempest-AttachVolumeNegativeTest-836381067-project Sep 01 14:11:19.580696 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: method: > Sep 01 14:11:19.580696 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: exception: Instance 91814986-adf4-46cb-8edf-820106d37ecb could not be found. Sep 01 14:11:19.580696 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: action_args: {'id': '91814986-adf4-46cb-8edf-820106d37ecb'} Sep 01 14:11:19.581581 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:11:19.581581 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:11:19.581581 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:11:19.581581 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:11:19.581581 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:11:19.581581 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:11:19.581581 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:11:19.581581 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:11:19.581581 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:11:19.581581 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:11:19.581581 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91814986-adf4-46cb-8edf-820106d37ecb could not be found. Sep 01 14:11:19.581581 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:11:19.581581 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:11:19.581581 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:11:19.581581 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:11:19.581581 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:11:19.581581 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:11:19.581581 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:11:19.581581 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:11:19.581581 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:11:19.583222 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:11:19.583222 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:11:19.583222 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:11:19.583222 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:11:19.583222 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:11:19.583222 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:11:19.583222 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:11:19.583222 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91814986-adf4-46cb-8edf-820106d37ecb could not be found. Sep 01 14:11:19.583222 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:11:19.583222 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:11:19.583222 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:11:19.583222 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:11:19.583222 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:11:19.583222 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:11:19.583222 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:11:19.583222 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:11:19.583222 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91814986-adf4-46cb-8edf-820106d37ecb could not be found. Sep 01 14:11:19.583222 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:11:19.585251 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-dd8945cd-814d-4f2a-a1a6-a167ca455739 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Returning 404 to user: Instance 91814986-adf4-46cb-8edf-820106d37ecb could not be found. {{(pid=121340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:11:19.586213 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-dd8945cd-814d-4f2a-a1a6-a167ca455739 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb" status: 404 len: 111 microversion: 2.1 time: 0.041265 Sep 01 14:11:19.587246 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 359/699] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:19 2022] GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:11:19.606299 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-4898349f-93bb-44d4-b78b-ed3dc2dc705a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '.version_select at 0x7f9867968310>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:19.713176 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-4898349f-93bb-44d4-b78b-ed3dc2dc705a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1950389809" status: 202 len: 0 microversion: 2.1 time: 0.119270 Sep 01 14:11:19.713937 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 360/700] 10.222.0.25 () {58 vars in 1221 bytes} [Thu Sep 1 14:11:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1950389809 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 14:11:20.014680 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-01097b8d-7e22-403b-ac95-09b10e714753 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:20.032514 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-01097b8d-7e22-403b-ac95-09b10e714753 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1753 microversion: 2.1 time: 0.606100 Sep 01 14:11:20.034321 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 341/701] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:19 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1753 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:20.063953 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-4072ac70-8e10-4d19-a935-7a74df3742ce tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:20.063953 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-4072ac70-8e10-4d19-a935-7a74df3742ce tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:20.077891 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4072ac70-8e10-4d19-a935-7a74df3742ce tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:20.081277 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4072ac70-8e10-4d19-a935-7a74df3742ce tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:20.082712 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4072ac70-8e10-4d19-a935-7a74df3742ce tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:20.084403 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4072ac70-8e10-4d19-a935-7a74df3742ce tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:20.085564 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4072ac70-8e10-4d19-a935-7a74df3742ce tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:20.086645 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4072ac70-8e10-4d19-a935-7a74df3742ce tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:20.380212 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-4072ac70-8e10-4d19-a935-7a74df3742ce tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:20.392666 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-4072ac70-8e10-4d19-a935-7a74df3742ce tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1674 microversion: 2.1 time: 0.335439 Sep 01 14:11:20.393500 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 361/702] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:20 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1674 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:20.701549 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [req-9594ac8d-5de3-4fc3-9456-a7b1b3b3c97f req-0f6dcc01-79ce-4ecd-a537-fc14f8444bdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1988647a-695e-49b8-a5d3-dd6c93c10ae5", "tag": "f27eab44-1c4b-4c5c-95ab-4dbdc5728861"}]} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:11:20.715172 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-9594ac8d-5de3-4fc3-9456-a7b1b3b3c97f req-0f6dcc01-79ce-4ecd-a537-fc14f8444bdf service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:20.715855 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-9594ac8d-5de3-4fc3-9456-a7b1b3b3c97f req-0f6dcc01-79ce-4ecd-a537-fc14f8444bdf service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:20.716480 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-9594ac8d-5de3-4fc3-9456-a7b1b3b3c97f req-0f6dcc01-79ce-4ecd-a537-fc14f8444bdf service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:20.736498 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.compute.server_external_events [req-9594ac8d-5de3-4fc3-9456-a7b1b3b3c97f req-0f6dcc01-79ce-4ecd-a537-fc14f8444bdf service nova] Creating event network-changed:f27eab44-1c4b-4c5c-95ab-4dbdc5728861 for instance 1988647a-695e-49b8-a5d3-dd6c93c10ae5 on hv-cinder-85221 Sep 01 14:11:20.761515 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [req-9594ac8d-5de3-4fc3-9456-a7b1b3b3c97f req-0f6dcc01-79ce-4ecd-a537-fc14f8444bdf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064685 Sep 01 14:11:20.764176 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 342/703] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:11:20.979108 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-9e39f449-9fcc-4de0-bec8-3c126cb08c9f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Action: 'create', calling method: .version_select at 0x7f98678e63a0>, body: {"keypair": {"name": "tempest-keypair-1571845779", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIskAkYIcJ9fM8BXYiJTF06PVdPjQ/gos8zDlph3TWUF/c5vVbiZlwLepsHj6lpDJCkIiYAxgmk7wLF5MyIT+hJk7L+VY4CCbLp73lvxftz7nPl9zgHCKins/B0nRmleng=="}} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:11:20.997744 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.quota [None req-9e39f449-9fcc-4de0-bec8-3c126cb08c9f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Getting quotas for project 90a84500a899479aabfa3aeb72b4c4ae. Resources: {'key_pairs'} {{(pid=121340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:11:21.004353 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.quota [None req-9e39f449-9fcc-4de0-bec8-3c126cb08c9f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Getting quotas for user 7ae66df61a764a42a1b1b15f54d5c34b and project 90a84500a899479aabfa3aeb72b4c4ae. Resources: {'key_pairs'} {{(pid=121340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:11:21.060281 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-70ca4fcd-bbb2-4e59-87e6-254f8c2a016e tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:21.061074 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-70ca4fcd-bbb2-4e59-87e6-254f8c2a016e tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:21.069601 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-70ca4fcd-bbb2-4e59-87e6-254f8c2a016e tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:21.070147 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-70ca4fcd-bbb2-4e59-87e6-254f8c2a016e tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:21.070599 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-70ca4fcd-bbb2-4e59-87e6-254f8c2a016e tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:21.071348 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-70ca4fcd-bbb2-4e59-87e6-254f8c2a016e tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:21.071813 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-70ca4fcd-bbb2-4e59-87e6-254f8c2a016e tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:21.072455 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-70ca4fcd-bbb2-4e59-87e6-254f8c2a016e tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:21.140305 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-9e39f449-9fcc-4de0-bec8-3c126cb08c9f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.167412 Sep 01 14:11:21.141936 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 362/704] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Sep 1 14:11:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:11:21.278499 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-70ca4fcd-bbb2-4e59-87e6-254f8c2a016e tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:21.294649 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-70ca4fcd-bbb2-4e59-87e6-254f8c2a016e tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1753 microversion: 2.1 time: 0.239445 Sep 01 14:11:21.295664 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 343/705] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:21 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1753 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:21.424921 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-7ee13a64-a374-448c-9d0b-d4766326cbc8 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:21.425686 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-7ee13a64-a374-448c-9d0b-d4766326cbc8 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:21.433493 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7ee13a64-a374-448c-9d0b-d4766326cbc8 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:21.434168 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7ee13a64-a374-448c-9d0b-d4766326cbc8 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:21.434686 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7ee13a64-a374-448c-9d0b-d4766326cbc8 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:21.435581 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7ee13a64-a374-448c-9d0b-d4766326cbc8 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:21.436207 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7ee13a64-a374-448c-9d0b-d4766326cbc8 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:21.436839 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7ee13a64-a374-448c-9d0b-d4766326cbc8 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:21.800238 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-7ee13a64-a374-448c-9d0b-d4766326cbc8 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:21.815431 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-7ee13a64-a374-448c-9d0b-d4766326cbc8 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1674 microversion: 2.1 time: 0.397526 Sep 01 14:11:21.816609 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 363/706] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:21 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1674 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:11:22.327097 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-8ddeadaf-5438-4de3-81b8-4eb5a9625cc4 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:22.329009 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-8ddeadaf-5438-4de3-81b8-4eb5a9625cc4 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:22.345465 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8ddeadaf-5438-4de3-81b8-4eb5a9625cc4 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:22.346313 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8ddeadaf-5438-4de3-81b8-4eb5a9625cc4 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:22.346930 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8ddeadaf-5438-4de3-81b8-4eb5a9625cc4 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:22.351308 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8ddeadaf-5438-4de3-81b8-4eb5a9625cc4 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:22.351308 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8ddeadaf-5438-4de3-81b8-4eb5a9625cc4 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:22.351308 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8ddeadaf-5438-4de3-81b8-4eb5a9625cc4 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:22.797958 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [req-77441fc7-b2a9-4031-b505-149184dc886f req-8fe9d55c-2b78-41fd-8037-52c6acabbffd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1988647a-695e-49b8-a5d3-dd6c93c10ae5", "tag": "f27eab44-1c4b-4c5c-95ab-4dbdc5728861"}]} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:11:22.800158 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-8ddeadaf-5438-4de3-81b8-4eb5a9625cc4 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:22.810362 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-77441fc7-b2a9-4031-b505-149184dc886f req-8fe9d55c-2b78-41fd-8037-52c6acabbffd service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:22.810775 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-77441fc7-b2a9-4031-b505-149184dc886f req-8fe9d55c-2b78-41fd-8037-52c6acabbffd service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:22.810999 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-77441fc7-b2a9-4031-b505-149184dc886f req-8fe9d55c-2b78-41fd-8037-52c6acabbffd service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:22.812248 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-8ddeadaf-5438-4de3-81b8-4eb5a9625cc4 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1753 microversion: 2.1 time: 0.489149 Sep 01 14:11:22.813745 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 344/707] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:22 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1753 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:11:22.825161 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.compute.server_external_events [req-77441fc7-b2a9-4031-b505-149184dc886f req-8fe9d55c-2b78-41fd-8037-52c6acabbffd service nova] Creating event network-changed:f27eab44-1c4b-4c5c-95ab-4dbdc5728861 for instance 1988647a-695e-49b8-a5d3-dd6c93c10ae5 on hv-cinder-85221 Sep 01 14:11:22.841120 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [req-77441fc7-b2a9-4031-b505-149184dc886f req-8fe9d55c-2b78-41fd-8037-52c6acabbffd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047739 Sep 01 14:11:22.842679 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 364/708] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:11:22.850233 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-bf1397d4-7e67-4609-a981-c0db6a2a1fab tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:22.850841 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-bf1397d4-7e67-4609-a981-c0db6a2a1fab tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:22.857761 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-bf1397d4-7e67-4609-a981-c0db6a2a1fab tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:22.858306 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-bf1397d4-7e67-4609-a981-c0db6a2a1fab tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:22.858753 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-bf1397d4-7e67-4609-a981-c0db6a2a1fab tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:22.859504 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-bf1397d4-7e67-4609-a981-c0db6a2a1fab tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:22.860772 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-bf1397d4-7e67-4609-a981-c0db6a2a1fab tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:22.860772 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-bf1397d4-7e67-4609-a981-c0db6a2a1fab tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:23.239554 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-bf1397d4-7e67-4609-a981-c0db6a2a1fab tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:23.248060 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-bf1397d4-7e67-4609-a981-c0db6a2a1fab tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1674 microversion: 2.1 time: 0.404370 Sep 01 14:11:23.248774 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 345/709] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:22 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1674 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:23.853656 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-15163e7d-9a55-4d9f-98fe-fe8e53dbc531 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:23.855253 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-15163e7d-9a55-4d9f-98fe-fe8e53dbc531 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:23.868176 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-15163e7d-9a55-4d9f-98fe-fe8e53dbc531 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:23.869046 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-15163e7d-9a55-4d9f-98fe-fe8e53dbc531 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:23.869859 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-15163e7d-9a55-4d9f-98fe-fe8e53dbc531 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:23.871573 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-15163e7d-9a55-4d9f-98fe-fe8e53dbc531 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:23.872662 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-15163e7d-9a55-4d9f-98fe-fe8e53dbc531 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:23.873667 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-15163e7d-9a55-4d9f-98fe-fe8e53dbc531 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:24.272712 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-29c51dc2-0364-4cb5-905f-ad6d9659b156 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:24.273443 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-29c51dc2-0364-4cb5-905f-ad6d9659b156 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:24.280703 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-29c51dc2-0364-4cb5-905f-ad6d9659b156 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:24.281204 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-29c51dc2-0364-4cb5-905f-ad6d9659b156 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:24.282199 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-29c51dc2-0364-4cb5-905f-ad6d9659b156 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:24.282945 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-29c51dc2-0364-4cb5-905f-ad6d9659b156 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:24.283413 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-29c51dc2-0364-4cb5-905f-ad6d9659b156 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:24.283842 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-29c51dc2-0364-4cb5-905f-ad6d9659b156 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:24.287159 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:11:24.531176 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-29c51dc2-0364-4cb5-905f-ad6d9659b156 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:24.540326 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-29c51dc2-0364-4cb5-905f-ad6d9659b156 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1606 microversion: 2.1 time: 0.271661 Sep 01 14:11:24.541306 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 346/710] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:24 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1606 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:11:24.849062 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-15163e7d-9a55-4d9f-98fe-fe8e53dbc531 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:24.863614 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-15163e7d-9a55-4d9f-98fe-fe8e53dbc531 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1758 microversion: 2.1 time: 1.020272 Sep 01 14:11:24.874015 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [req-bb57c376-ba31-4afb-a93c-8b4b2909190d req-598b7026-db0c-4445-ad33-c9132e8a359e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c2b8351-0db7-45ab-848a-1e339e67bcf7", "name": "network-vif-deleted", "tag": "39a55af7-1a2a-41f8-b092-76d3ddca0161"}]} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:11:24.874921 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 365/711] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:23 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1758 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:24.894348 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-bb57c376-ba31-4afb-a93c-8b4b2909190d req-598b7026-db0c-4445-ad33-c9132e8a359e service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:24.894348 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-bb57c376-ba31-4afb-a93c-8b4b2909190d req-598b7026-db0c-4445-ad33-c9132e8a359e service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:24.895047 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-bb57c376-ba31-4afb-a93c-8b4b2909190d req-598b7026-db0c-4445-ad33-c9132e8a359e service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:24.907845 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.compute.server_external_events [req-bb57c376-ba31-4afb-a93c-8b4b2909190d req-598b7026-db0c-4445-ad33-c9132e8a359e service nova] Creating event network-vif-deleted:39a55af7-1a2a-41f8-b092-76d3ddca0161 for instance 1c2b8351-0db7-45ab-848a-1e339e67bcf7 on hv-cinder-85221 Sep 01 14:11:24.913404 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [req-bb57c376-ba31-4afb-a93c-8b4b2909190d req-598b7026-db0c-4445-ad33-c9132e8a359e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054069 Sep 01 14:11:24.914068 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 347/712] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:11:25.365079 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-ebd68092-5bd9-4416-ac46-5cfb5d1e6131 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1990186452", "imageRef": "9be77128-e763-4225-b76f-85fbb04ad9b2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4f2459fa-f112-4ee1-abd3-6f4952507858"}], "security_groups": [{"name": "tempest-securitygroup--1122447274"}], "key_name": "tempest-keypair-1571845779", "user_data": "}} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:11:25.541532 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.network.neutron [None req-ebd68092-5bd9-4416-ac46-5cfb5d1e6131 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] validate_networks() for [('4f2459fa-f112-4ee1-abd3-6f4952507858', None, None, None, None, None)] {{(pid=121340) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:11:25.568996 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-52205687-fa4a-4a29-b2b8-e3e1d1f2d970 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:25.570827 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-52205687-fa4a-4a29-b2b8-e3e1d1f2d970 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:25.586594 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-52205687-fa4a-4a29-b2b8-e3e1d1f2d970 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:25.587454 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-52205687-fa4a-4a29-b2b8-e3e1d1f2d970 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:25.588473 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-52205687-fa4a-4a29-b2b8-e3e1d1f2d970 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:25.589872 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-52205687-fa4a-4a29-b2b8-e3e1d1f2d970 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:25.590859 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-52205687-fa4a-4a29-b2b8-e3e1d1f2d970 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:25.591383 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-52205687-fa4a-4a29-b2b8-e3e1d1f2d970 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:25.672245 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-52205687-fa4a-4a29-b2b8-e3e1d1f2d970 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:25.682920 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-52205687-fa4a-4a29-b2b8-e3e1d1f2d970 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1606 microversion: 2.1 time: 0.123301 Sep 01 14:11:25.698051 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 348/713] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:25 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1606 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:25.908223 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-72092b4a-1e9e-49aa-b641-53c3330c92c2 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:25.909419 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-72092b4a-1e9e-49aa-b641-53c3330c92c2 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:25.920035 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-72092b4a-1e9e-49aa-b641-53c3330c92c2 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:25.920644 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-72092b4a-1e9e-49aa-b641-53c3330c92c2 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:25.921279 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-72092b4a-1e9e-49aa-b641-53c3330c92c2 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:25.923019 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-72092b4a-1e9e-49aa-b641-53c3330c92c2 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:25.923437 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-72092b4a-1e9e-49aa-b641-53c3330c92c2 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:25.923876 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-72092b4a-1e9e-49aa-b641-53c3330c92c2 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:26.373293 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-72092b4a-1e9e-49aa-b641-53c3330c92c2 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:26.383795 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-72092b4a-1e9e-49aa-b641-53c3330c92c2 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1758 microversion: 2.1 time: 0.483788 Sep 01 14:11:26.397244 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 349/714] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:25 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1758 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:11:26.452440 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-ebd68092-5bd9-4416-ac46-5cfb5d1e6131 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Flavor limits 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:11:26.453230 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-ebd68092-5bd9-4416-ac46-5cfb5d1e6131 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Image limits 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:11:26.453494 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-ebd68092-5bd9-4416-ac46-5cfb5d1e6131 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Flavor pref 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:11:26.453978 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-ebd68092-5bd9-4416-ac46-5cfb5d1e6131 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Image pref 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:11:26.455511 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-ebd68092-5bd9-4416-ac46-5cfb5d1e6131 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:11:26.465252 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ebd68092-5bd9-4416-ac46-5cfb5d1e6131 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:26.465754 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ebd68092-5bd9-4416-ac46-5cfb5d1e6131 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:26.471305 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ebd68092-5bd9-4416-ac46-5cfb5d1e6131 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:26.471305 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ebd68092-5bd9-4416-ac46-5cfb5d1e6131 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:26.471305 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ebd68092-5bd9-4416-ac46-5cfb5d1e6131 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:26.471305 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ebd68092-5bd9-4416-ac46-5cfb5d1e6131 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:26.487718 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.quota [None req-ebd68092-5bd9-4416-ac46-5cfb5d1e6131 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Getting quotas for project 90a84500a899479aabfa3aeb72b4c4ae. Resources: {'cores', 'instances', 'ram'} {{(pid=121340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:11:26.492605 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.quota [None req-ebd68092-5bd9-4416-ac46-5cfb5d1e6131 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Getting quotas for user 7ae66df61a764a42a1b1b15f54d5c34b and project 90a84500a899479aabfa3aeb72b4c4ae. Resources: {'cores', 'instances', 'ram'} {{(pid=121340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:11:26.494541 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:11:26.511119 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-ebd68092-5bd9-4416-ac46-5cfb5d1e6131 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Going to run 1 instances... {{(pid=121340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:11:26.511119 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-ebd68092-5bd9-4416-ac46-5cfb5d1e6131 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9be77128-e763-4225-b76f-85fbb04ad9b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:11:26.680632 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-ebd68092-5bd9-4416-ac46-5cfb5d1e6131 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.321882 Sep 01 14:11:26.681613 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 366/715] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 1 14:11:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 1323 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 14:11:26.696730 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-185c905e-04ab-4e8d-b35f-f3688ff80ed3 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:26.698099 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-185c905e-04ab-4e8d-b35f-f3688ff80ed3 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:26.720326 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-3c13e16f-5834-4470-a60b-1c35a47aa0ed tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:26.723458 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-3c13e16f-5834-4470-a60b-1c35a47aa0ed tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:26.734654 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3c13e16f-5834-4470-a60b-1c35a47aa0ed tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:26.736457 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3c13e16f-5834-4470-a60b-1c35a47aa0ed tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:26.736976 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3c13e16f-5834-4470-a60b-1c35a47aa0ed tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:26.738407 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3c13e16f-5834-4470-a60b-1c35a47aa0ed tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:26.739141 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3c13e16f-5834-4470-a60b-1c35a47aa0ed tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:26.739801 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3c13e16f-5834-4470-a60b-1c35a47aa0ed tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:26.747624 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:11:26.809483 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-185c905e-04ab-4e8d-b35f-f3688ff80ed3 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:26.825401 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-185c905e-04ab-4e8d-b35f-f3688ff80ed3 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce" status: 200 len: 1242 microversion: 2.1 time: 0.135858 Sep 01 14:11:26.827212 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 350/716] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:26 2022] GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce => generated 1242 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:26.857940 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-3c13e16f-5834-4470-a60b-1c35a47aa0ed tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:26.867707 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-3c13e16f-5834-4470-a60b-1c35a47aa0ed tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1606 microversion: 2.1 time: 0.153944 Sep 01 14:11:26.868411 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 367/717] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:26 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1606 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:27.412366 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-1063fd83-bc28-428d-b6d4-dc909480a10d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:27.412761 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-1063fd83-bc28-428d-b6d4-dc909480a10d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:27.420102 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1063fd83-bc28-428d-b6d4-dc909480a10d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:27.421321 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1063fd83-bc28-428d-b6d4-dc909480a10d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:27.422659 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1063fd83-bc28-428d-b6d4-dc909480a10d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:27.423636 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1063fd83-bc28-428d-b6d4-dc909480a10d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:27.424302 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1063fd83-bc28-428d-b6d4-dc909480a10d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:27.424897 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1063fd83-bc28-428d-b6d4-dc909480a10d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:27.692020 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-1063fd83-bc28-428d-b6d4-dc909480a10d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:27.703079 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-1063fd83-bc28-428d-b6d4-dc909480a10d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1758 microversion: 2.1 time: 0.294821 Sep 01 14:11:27.704704 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 351/718] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:27 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1758 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:11:27.852900 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-dce6e936-04c4-48ba-96b7-660f0c16a4f4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:27.852900 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-dce6e936-04c4-48ba-96b7-660f0c16a4f4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:27.895340 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-2d799ef0-5714-4079-9ef2-8235c016c64f tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:27.896275 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-2d799ef0-5714-4079-9ef2-8235c016c64f tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:27.909653 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2d799ef0-5714-4079-9ef2-8235c016c64f tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:27.911580 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2d799ef0-5714-4079-9ef2-8235c016c64f tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:27.912292 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2d799ef0-5714-4079-9ef2-8235c016c64f tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:27.913565 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2d799ef0-5714-4079-9ef2-8235c016c64f tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:27.914604 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2d799ef0-5714-4079-9ef2-8235c016c64f tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:27.915360 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2d799ef0-5714-4079-9ef2-8235c016c64f tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:27.971288 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-dce6e936-04c4-48ba-96b7-660f0c16a4f4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:27.979844 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-dce6e936-04c4-48ba-96b7-660f0c16a4f4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce" status: 200 len: 1242 microversion: 2.1 time: 0.134342 Sep 01 14:11:27.992803 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2d799ef0-5714-4079-9ef2-8235c016c64f tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:27.993561 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2d799ef0-5714-4079-9ef2-8235c016c64f tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:27.994581 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2d799ef0-5714-4079-9ef2-8235c016c64f tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:27.995107 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.objects.instance [None req-2d799ef0-5714-4079-9ef2-8235c016c64f tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lazy-loading 'fault' on Instance uuid 1c2b8351-0db7-45ab-848a-1e339e67bcf7 {{(pid=121339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:11:27.996975 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 368/719] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:27 2022] GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce => generated 1242 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:11:28.066850 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-2d799ef0-5714-4079-9ef2-8235c016c64f tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:28.081934 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-2d799ef0-5714-4079-9ef2-8235c016c64f tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1327 microversion: 2.1 time: 0.193864 Sep 01 14:11:28.083174 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 352/720] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:27 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1327 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:28.729887 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-752a3bd1-4dc3-443c-ba95-0ce5c1dfc4cb tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:28.730629 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-752a3bd1-4dc3-443c-ba95-0ce5c1dfc4cb tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:28.739407 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-752a3bd1-4dc3-443c-ba95-0ce5c1dfc4cb tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:28.739965 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-752a3bd1-4dc3-443c-ba95-0ce5c1dfc4cb tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:28.740473 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-752a3bd1-4dc3-443c-ba95-0ce5c1dfc4cb tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:28.741249 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-752a3bd1-4dc3-443c-ba95-0ce5c1dfc4cb tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:28.741860 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-752a3bd1-4dc3-443c-ba95-0ce5c1dfc4cb tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:28.742387 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-752a3bd1-4dc3-443c-ba95-0ce5c1dfc4cb tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:28.943889 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-752a3bd1-4dc3-443c-ba95-0ce5c1dfc4cb tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:28.965811 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-752a3bd1-4dc3-443c-ba95-0ce5c1dfc4cb tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1758 microversion: 2.1 time: 0.240663 Sep 01 14:11:28.966505 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 369/721] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:28 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1758 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:29.008227 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-80425c60-d8a8-4da2-a1a6-90963b4f0196 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:29.009139 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-80425c60-d8a8-4da2-a1a6-90963b4f0196 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:29.018706 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-80425c60-d8a8-4da2-a1a6-90963b4f0196 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:29.019507 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-80425c60-d8a8-4da2-a1a6-90963b4f0196 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:29.020091 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-80425c60-d8a8-4da2-a1a6-90963b4f0196 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:29.020926 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-80425c60-d8a8-4da2-a1a6-90963b4f0196 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:29.021493 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-80425c60-d8a8-4da2-a1a6-90963b4f0196 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:29.022204 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-80425c60-d8a8-4da2-a1a6-90963b4f0196 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:29.100502 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-80425c60-d8a8-4da2-a1a6-90963b4f0196 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:29.113457 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-80425c60-d8a8-4da2-a1a6-90963b4f0196 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce" status: 200 len: 1238 microversion: 2.1 time: 0.109601 Sep 01 14:11:29.115151 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 353/722] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:29 2022] GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce => generated 1238 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:29.137124 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-781012dc-9fbc-470c-b734-1f1735a27f49 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:29.137732 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-781012dc-9fbc-470c-b734-1f1735a27f49 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:29.145332 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-781012dc-9fbc-470c-b734-1f1735a27f49 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:29.145869 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-781012dc-9fbc-470c-b734-1f1735a27f49 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:29.146343 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-781012dc-9fbc-470c-b734-1f1735a27f49 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:29.147094 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-781012dc-9fbc-470c-b734-1f1735a27f49 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:29.147591 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-781012dc-9fbc-470c-b734-1f1735a27f49 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:29.148027 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-781012dc-9fbc-470c-b734-1f1735a27f49 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:29.190521 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-781012dc-9fbc-470c-b734-1f1735a27f49 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:29.191033 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-781012dc-9fbc-470c-b734-1f1735a27f49 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:29.191478 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-781012dc-9fbc-470c-b734-1f1735a27f49 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:29.191940 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.objects.instance [None req-781012dc-9fbc-470c-b734-1f1735a27f49 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lazy-loading 'fault' on Instance uuid 1c2b8351-0db7-45ab-848a-1e339e67bcf7 {{(pid=121340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:11:29.269372 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-781012dc-9fbc-470c-b734-1f1735a27f49 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:29.282407 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-781012dc-9fbc-470c-b734-1f1735a27f49 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 200 len: 1327 microversion: 2.1 time: 0.148899 Sep 01 14:11:29.283381 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 370/723] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:29 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 1327 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:29.991993 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-bdc92418-c990-4228-808d-2842bd96540f tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:29.992608 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-bdc92418-c990-4228-808d-2842bd96540f tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:29.999028 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-bdc92418-c990-4228-808d-2842bd96540f tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:29.999569 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-bdc92418-c990-4228-808d-2842bd96540f tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:30.000008 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-bdc92418-c990-4228-808d-2842bd96540f tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:30.001245 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-bdc92418-c990-4228-808d-2842bd96540f tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:30.001703 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-bdc92418-c990-4228-808d-2842bd96540f tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:30.002162 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-bdc92418-c990-4228-808d-2842bd96540f tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:30.138842 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-16e97a5f-cc35-489c-92e6-2eb3f13b8032 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:30.139796 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-16e97a5f-cc35-489c-92e6-2eb3f13b8032 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:30.147781 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-16e97a5f-cc35-489c-92e6-2eb3f13b8032 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:30.148542 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-16e97a5f-cc35-489c-92e6-2eb3f13b8032 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:30.149077 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-16e97a5f-cc35-489c-92e6-2eb3f13b8032 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:30.149965 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-16e97a5f-cc35-489c-92e6-2eb3f13b8032 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:30.150440 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-16e97a5f-cc35-489c-92e6-2eb3f13b8032 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:30.150870 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-16e97a5f-cc35-489c-92e6-2eb3f13b8032 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:30.182362 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-bdc92418-c990-4228-808d-2842bd96540f tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:30.189049 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-bdc92418-c990-4228-808d-2842bd96540f tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1758 microversion: 2.1 time: 0.200475 Sep 01 14:11:30.190158 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 354/724] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:29 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1758 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:30.220038 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-16e97a5f-cc35-489c-92e6-2eb3f13b8032 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:30.228694 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-16e97a5f-cc35-489c-92e6-2eb3f13b8032 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce" status: 200 len: 1294 microversion: 2.1 time: 0.093643 Sep 01 14:11:30.229299 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 371/725] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:30 2022] GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce => generated 1294 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:11:30.306151 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-e6b969a6-fc13-4ca0-97cb-a79a9451aa0e tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:30.306555 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-e6b969a6-fc13-4ca0-97cb-a79a9451aa0e tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:30.313482 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e6b969a6-fc13-4ca0-97cb-a79a9451aa0e tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:30.314160 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e6b969a6-fc13-4ca0-97cb-a79a9451aa0e tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:30.314807 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e6b969a6-fc13-4ca0-97cb-a79a9451aa0e tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:30.315538 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e6b969a6-fc13-4ca0-97cb-a79a9451aa0e tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:30.315993 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e6b969a6-fc13-4ca0-97cb-a79a9451aa0e tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:30.316410 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e6b969a6-fc13-4ca0-97cb-a79a9451aa0e tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:30.332911 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.wsgi [None req-e6b969a6-fc13-4ca0-97cb-a79a9451aa0e tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] HTTP exception thrown: Instance 1c2b8351-0db7-45ab-848a-1e339e67bcf7 could not be found. Sep 01 14:11:30.334960 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-e6b969a6-fc13-4ca0-97cb-a79a9451aa0e tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Request method failure captured: Sep 01 14:11:30.334960 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: request: GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 HTTP/1.1 Sep 01 14:11:30.334960 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept: application/json Sep 01 14:11:30.334960 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept-Encoding: identity Sep 01 14:11:30.334960 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Connection: close Sep 01 14:11:30.334960 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Length: 0 Sep 01 14:11:30.334960 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Type: application/json Sep 01 14:11:30.334960 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Host: 10.222.0.25 Sep 01 14:11:30.334960 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Openstack-System-Scope: None Sep 01 14:11:30.334960 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: User-Agent: python-urllib3/1.26.12 Sep 01 14:11:30.334960 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Auth-Token: gAAAAABjELxJFCqHL6iDW93p2fAK82qpj7L1D7D7ilryiMV3DyGHDC5twKjpobCzpdbmKrw1i62S3hizpMOIs5ob_AyQm5W6dnNLK6OpjiuLVoCJElwf7M_K99jJdNFPOzu8jRRuhJkpEHOKHKZFt9UvUOXe97P6WYXoFXwhzBcefsvHS2el000 Sep 01 14:11:30.334960 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Id: None Sep 01 14:11:30.334960 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Name: None Sep 01 14:11:30.334960 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Identity-Status: Confirmed Sep 01 14:11:30.334960 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Is-Admin-Project: True Sep 01 14:11:30.334960 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Id: default Sep 01 14:11:30.334960 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Name: Default Sep 01 14:11:30.334960 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Id: eaba67e3a54f4191b9b924305a83e4eb Sep 01 14:11:30.334960 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Name: tempest-AttachVolumeTestJSON-224345679 Sep 01 14:11:30.334960 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Role: member,reader Sep 01 14:11:30.334960 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Roles: member,reader Sep 01 14:11:30.339613 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaba67e3a54f4191b9b924305a83e4eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eaba67e3a54f4191b9b924305a83e4eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaba67e3a54f4191b9b924305a83e4eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eaba67e3a54f4191b9b924305a83e4eb"}]}] Sep 01 14:11:30.339613 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant: tempest-AttachVolumeTestJSON-224345679 Sep 01 14:11:30.339613 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Id: eaba67e3a54f4191b9b924305a83e4eb Sep 01 14:11:30.339613 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Name: tempest-AttachVolumeTestJSON-224345679 Sep 01 14:11:30.339613 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User: tempest-AttachVolumeTestJSON-224345679-project Sep 01 14:11:30.339613 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Id: default Sep 01 14:11:30.339613 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Name: Default Sep 01 14:11:30.339613 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Id: ff664c7ba095413daad6b3f1ebc49cc0 Sep 01 14:11:30.339613 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Name: tempest-AttachVolumeTestJSON-224345679-project Sep 01 14:11:30.339613 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: method: > Sep 01 14:11:30.339613 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: exception: Instance 1c2b8351-0db7-45ab-848a-1e339e67bcf7 could not be found. Sep 01 14:11:30.339613 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: action_args: {'id': '1c2b8351-0db7-45ab-848a-1e339e67bcf7'} Sep 01 14:11:30.340851 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:11:30.340851 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:11:30.340851 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:11:30.340851 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:11:30.340851 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:11:30.340851 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:11:30.340851 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:11:30.340851 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:11:30.340851 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:11:30.340851 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:11:30.340851 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c2b8351-0db7-45ab-848a-1e339e67bcf7 could not be found. Sep 01 14:11:30.340851 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:11:30.340851 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:11:30.340851 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:11:30.340851 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:11:30.340851 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:11:30.340851 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:11:30.340851 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:11:30.340851 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:11:30.340851 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:11:30.342596 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:11:30.342596 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:11:30.342596 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:11:30.342596 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:11:30.342596 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:11:30.342596 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:11:30.342596 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:11:30.342596 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c2b8351-0db7-45ab-848a-1e339e67bcf7 could not be found. Sep 01 14:11:30.342596 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:11:30.342596 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:11:30.342596 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:11:30.342596 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:11:30.342596 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:11:30.342596 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:11:30.342596 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:11:30.342596 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:11:30.342596 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c2b8351-0db7-45ab-848a-1e339e67bcf7 could not be found. Sep 01 14:11:30.342596 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:11:30.345742 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-e6b969a6-fc13-4ca0-97cb-a79a9451aa0e tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Returning 404 to user: Instance 1c2b8351-0db7-45ab-848a-1e339e67bcf7 could not be found. {{(pid=121339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:11:30.345742 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-e6b969a6-fc13-4ca0-97cb-a79a9451aa0e tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 404 len: 111 microversion: 2.1 time: 0.034960 Sep 01 14:11:30.345742 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 355/726] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:30 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:11:30.350213 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-56690855-de54-4128-b97b-85cadb85280d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '.version_select at 0x7f9867aec550>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:30.450286 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-56690855-de54-4128-b97b-85cadb85280d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-622888630" status: 202 len: 0 microversion: 2.1 time: 0.105034 Sep 01 14:11:30.450880 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 372/727] 10.222.0.25 () {58 vars in 1218 bytes} [Thu Sep 1 14:11:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-622888630 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 14:11:31.214608 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-a77e5dd0-98d0-4d5d-b237-86ab9d19aa3d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:31.215226 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-a77e5dd0-98d0-4d5d-b237-86ab9d19aa3d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:31.222427 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a77e5dd0-98d0-4d5d-b237-86ab9d19aa3d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:31.222973 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a77e5dd0-98d0-4d5d-b237-86ab9d19aa3d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:31.223415 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a77e5dd0-98d0-4d5d-b237-86ab9d19aa3d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:31.224133 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a77e5dd0-98d0-4d5d-b237-86ab9d19aa3d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:31.224591 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a77e5dd0-98d0-4d5d-b237-86ab9d19aa3d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:31.225014 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a77e5dd0-98d0-4d5d-b237-86ab9d19aa3d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:31.254926 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-e9d32ca1-571d-4e25-ba0c-1b73b365f381 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:31.255981 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-e9d32ca1-571d-4e25-ba0c-1b73b365f381 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:31.266620 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e9d32ca1-571d-4e25-ba0c-1b73b365f381 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:31.267679 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e9d32ca1-571d-4e25-ba0c-1b73b365f381 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:31.268367 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e9d32ca1-571d-4e25-ba0c-1b73b365f381 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:31.269549 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e9d32ca1-571d-4e25-ba0c-1b73b365f381 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:31.270365 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e9d32ca1-571d-4e25-ba0c-1b73b365f381 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:31.270847 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e9d32ca1-571d-4e25-ba0c-1b73b365f381 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:31.385653 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-e9d32ca1-571d-4e25-ba0c-1b73b365f381 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:31.401153 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-e9d32ca1-571d-4e25-ba0c-1b73b365f381 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce" status: 200 len: 1294 microversion: 2.1 time: 0.153729 Sep 01 14:11:31.402245 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 373/728] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:31 2022] GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce => generated 1294 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:31.461316 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-d5ca4e0d-202c-4b21-ace4-d22fcced0ec1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Action: 'create', calling method: .version_select at 0x7f9867d13430>, body: {"keypair": {"name": "tempest-keypair-610374008", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBKDGxOCiSxctyZDj++6qBdz00UkqcYtyD2VPbmriuzYg4t7QsufyGPR2pgFl8I3oHlXU54JW+ph1YVFuQRcmu0Vi1Dm9sxTUJ/tqcfhO1eNCpO+3eVnYBZg1IGPCJ2xw=="}} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:11:31.465320 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-a77e5dd0-98d0-4d5d-b237-86ab9d19aa3d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:31.477712 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-a77e5dd0-98d0-4d5d-b237-86ab9d19aa3d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1758 microversion: 2.1 time: 0.266740 Sep 01 14:11:31.479084 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 356/729] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:31 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1758 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:31.482613 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.quota [None req-d5ca4e0d-202c-4b21-ace4-d22fcced0ec1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Getting quotas for project eaba67e3a54f4191b9b924305a83e4eb. Resources: {'key_pairs'} {{(pid=121340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:11:31.487636 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.quota [None req-d5ca4e0d-202c-4b21-ace4-d22fcced0ec1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Getting quotas for user ff664c7ba095413daad6b3f1ebc49cc0 and project eaba67e3a54f4191b9b924305a83e4eb. Resources: {'key_pairs'} {{(pid=121340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:11:31.645116 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-d5ca4e0d-202c-4b21-ace4-d22fcced0ec1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.188158 Sep 01 14:11:31.645944 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 374/730] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Sep 1 14:11:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:11:32.424809 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-b9204468-f2da-4be2-b50a-35f55ede91b1 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:32.425695 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-b9204468-f2da-4be2-b50a-35f55ede91b1 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:32.433920 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b9204468-f2da-4be2-b50a-35f55ede91b1 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:32.434423 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b9204468-f2da-4be2-b50a-35f55ede91b1 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:32.434890 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b9204468-f2da-4be2-b50a-35f55ede91b1 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:32.435820 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b9204468-f2da-4be2-b50a-35f55ede91b1 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:32.436278 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b9204468-f2da-4be2-b50a-35f55ede91b1 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:32.436704 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b9204468-f2da-4be2-b50a-35f55ede91b1 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:32.521008 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-e6c0f835-ca79-4b6a-8b90-3fbe68365514 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:32.528861 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-e6c0f835-ca79-4b6a-8b90-3fbe68365514 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:32.540851 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-b9204468-f2da-4be2-b50a-35f55ede91b1 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:32.553517 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e6c0f835-ca79-4b6a-8b90-3fbe68365514 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:32.554773 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e6c0f835-ca79-4b6a-8b90-3fbe68365514 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:32.555731 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e6c0f835-ca79-4b6a-8b90-3fbe68365514 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:32.556956 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e6c0f835-ca79-4b6a-8b90-3fbe68365514 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:32.557705 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e6c0f835-ca79-4b6a-8b90-3fbe68365514 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:32.558428 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e6c0f835-ca79-4b6a-8b90-3fbe68365514 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:32.562567 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-b9204468-f2da-4be2-b50a-35f55ede91b1 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce" status: 200 len: 1294 microversion: 2.1 time: 0.142992 Sep 01 14:11:32.568822 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 357/731] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:32 2022] GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce => generated 1294 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:32.892844 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-e6c0f835-ca79-4b6a-8b90-3fbe68365514 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:32.910241 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-e6c0f835-ca79-4b6a-8b90-3fbe68365514 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1758 microversion: 2.1 time: 0.399928 Sep 01 14:11:32.911302 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 375/732] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:32 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1758 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:33.590712 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-950af1ba-b6c5-46de-ba3b-84d7ae69b46e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:33.592673 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-950af1ba-b6c5-46de-ba3b-84d7ae69b46e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:33.606916 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-950af1ba-b6c5-46de-ba3b-84d7ae69b46e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:33.606916 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-950af1ba-b6c5-46de-ba3b-84d7ae69b46e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:33.606916 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-950af1ba-b6c5-46de-ba3b-84d7ae69b46e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:33.606916 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-950af1ba-b6c5-46de-ba3b-84d7ae69b46e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:33.608790 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-950af1ba-b6c5-46de-ba3b-84d7ae69b46e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:33.609688 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-950af1ba-b6c5-46de-ba3b-84d7ae69b46e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:33.689088 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-950af1ba-b6c5-46de-ba3b-84d7ae69b46e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:33.698437 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-950af1ba-b6c5-46de-ba3b-84d7ae69b46e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce" status: 200 len: 1300 microversion: 2.1 time: 0.112138 Sep 01 14:11:33.699060 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 358/733] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:33 2022] GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce => generated 1300 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:33.951013 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-b85b9f7f-b611-45da-a590-ae781058f725 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:33.952557 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-b85b9f7f-b611-45da-a590-ae781058f725 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:33.966961 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b85b9f7f-b611-45da-a590-ae781058f725 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:33.967811 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b85b9f7f-b611-45da-a590-ae781058f725 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:33.968556 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b85b9f7f-b611-45da-a590-ae781058f725 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:33.972729 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b85b9f7f-b611-45da-a590-ae781058f725 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:33.978710 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b85b9f7f-b611-45da-a590-ae781058f725 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:33.979621 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b85b9f7f-b611-45da-a590-ae781058f725 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:34.275151 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-b85b9f7f-b611-45da-a590-ae781058f725 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:34.285318 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-b85b9f7f-b611-45da-a590-ae781058f725 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1758 microversion: 2.1 time: 0.342517 Sep 01 14:11:34.286037 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 376/734] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:33 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1758 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:34.733183 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-cd80a3e3-aac2-431f-b473-f534b975c74e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:34.734286 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-cd80a3e3-aac2-431f-b473-f534b975c74e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:34.741639 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-cd80a3e3-aac2-431f-b473-f534b975c74e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:34.742176 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-cd80a3e3-aac2-431f-b473-f534b975c74e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:34.742615 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-cd80a3e3-aac2-431f-b473-f534b975c74e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:34.743321 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-cd80a3e3-aac2-431f-b473-f534b975c74e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:34.743783 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-cd80a3e3-aac2-431f-b473-f534b975c74e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:34.744204 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-cd80a3e3-aac2-431f-b473-f534b975c74e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:34.989929 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-cd80a3e3-aac2-431f-b473-f534b975c74e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:35.007138 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-cd80a3e3-aac2-431f-b473-f534b975c74e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce" status: 200 len: 1368 microversion: 2.1 time: 0.277521 Sep 01 14:11:35.008226 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 359/735] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:34 2022] GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce => generated 1368 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:35.194018 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-a5e56c37-401d-4247-acb2-c1befcf951b0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-140479486", "imageRef": "9be77128-e763-4225-b76f-85fbb04ad9b2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5efdbb74-e6fe-4a11-96cb-23855066e81b"}], "security_groups": [{"name": "tempest-securitygroup--1015837111"}], "key_name": "tempest-keypair-610374008", "user_data": "}} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:11:35.346529 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [req-6f498714-ba5c-4f62-9264-c8118e65c744 req-849d39c0-bd8a-453c-a39e-08123b1d04f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce", "tag": "13cc93c3-c869-44c3-b869-955e63001656"}]} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:11:35.358021 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-6f498714-ba5c-4f62-9264-c8118e65c744 req-849d39c0-bd8a-453c-a39e-08123b1d04f3 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:35.358328 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-6f498714-ba5c-4f62-9264-c8118e65c744 req-849d39c0-bd8a-453c-a39e-08123b1d04f3 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:35.358952 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-6f498714-ba5c-4f62-9264-c8118e65c744 req-849d39c0-bd8a-453c-a39e-08123b1d04f3 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:35.365378 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.network.neutron [None req-a5e56c37-401d-4247-acb2-c1befcf951b0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] validate_networks() for [('5efdbb74-e6fe-4a11-96cb-23855066e81b', None, None, None, None, None)] {{(pid=121340) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:11:35.391532 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.compute.server_external_events [req-6f498714-ba5c-4f62-9264-c8118e65c744 req-849d39c0-bd8a-453c-a39e-08123b1d04f3 service nova] Creating event network-changed:13cc93c3-c869-44c3-b869-955e63001656 for instance 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce on hv-cinder-85221 Sep 01 14:11:35.396868 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [req-6f498714-ba5c-4f62-9264-c8118e65c744 req-849d39c0-bd8a-453c-a39e-08123b1d04f3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154104 Sep 01 14:11:35.398090 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 360/736] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:11:35.410073 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-5cc2c3fa-4d47-4047-9755-2232477df7a3 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:35.411413 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-5cc2c3fa-4d47-4047-9755-2232477df7a3 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:35.426051 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5cc2c3fa-4d47-4047-9755-2232477df7a3 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:35.426929 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5cc2c3fa-4d47-4047-9755-2232477df7a3 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:35.427715 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5cc2c3fa-4d47-4047-9755-2232477df7a3 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:35.429043 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5cc2c3fa-4d47-4047-9755-2232477df7a3 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:35.429881 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5cc2c3fa-4d47-4047-9755-2232477df7a3 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:35.430663 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5cc2c3fa-4d47-4047-9755-2232477df7a3 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:35.803432 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-5cc2c3fa-4d47-4047-9755-2232477df7a3 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:35.816011 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-5cc2c3fa-4d47-4047-9755-2232477df7a3 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1758 microversion: 2.1 time: 0.416156 Sep 01 14:11:35.816680 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 361/737] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:35 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1758 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:36.042884 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-a66bc06c-3d7f-4e9d-b4f7-420fd360fb40 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:36.043507 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-a66bc06c-3d7f-4e9d-b4f7-420fd360fb40 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:36.054176 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a66bc06c-3d7f-4e9d-b4f7-420fd360fb40 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:36.055352 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a66bc06c-3d7f-4e9d-b4f7-420fd360fb40 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:36.056156 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a66bc06c-3d7f-4e9d-b4f7-420fd360fb40 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:36.057440 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a66bc06c-3d7f-4e9d-b4f7-420fd360fb40 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:36.058319 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a66bc06c-3d7f-4e9d-b4f7-420fd360fb40 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:36.059086 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a66bc06c-3d7f-4e9d-b4f7-420fd360fb40 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:36.351050 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-a5e56c37-401d-4247-acb2-c1befcf951b0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Flavor limits 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:11:36.351934 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-a5e56c37-401d-4247-acb2-c1befcf951b0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Image limits 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:11:36.352397 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-a5e56c37-401d-4247-acb2-c1befcf951b0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Flavor pref 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:11:36.352908 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-a5e56c37-401d-4247-acb2-c1befcf951b0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Image pref 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:11:36.353572 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-a5e56c37-401d-4247-acb2-c1befcf951b0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:11:36.367932 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a5e56c37-401d-4247-acb2-c1befcf951b0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:36.368504 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a5e56c37-401d-4247-acb2-c1befcf951b0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:36.369264 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a5e56c37-401d-4247-acb2-c1befcf951b0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:36.370232 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a5e56c37-401d-4247-acb2-c1befcf951b0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:36.370827 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a5e56c37-401d-4247-acb2-c1befcf951b0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:36.371510 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a5e56c37-401d-4247-acb2-c1befcf951b0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:36.381532 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-a66bc06c-3d7f-4e9d-b4f7-420fd360fb40 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:36.395530 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-a66bc06c-3d7f-4e9d-b4f7-420fd360fb40 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce" status: 200 len: 1368 microversion: 2.1 time: 0.363374 Sep 01 14:11:36.396443 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 362/738] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:36 2022] GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce => generated 1368 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:11:36.415691 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.quota [None req-a5e56c37-401d-4247-acb2-c1befcf951b0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Getting quotas for project eaba67e3a54f4191b9b924305a83e4eb. Resources: {'cores', 'instances', 'ram'} {{(pid=121340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:11:36.423803 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.quota [None req-a5e56c37-401d-4247-acb2-c1befcf951b0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Getting quotas for user ff664c7ba095413daad6b3f1ebc49cc0 and project eaba67e3a54f4191b9b924305a83e4eb. Resources: {'cores', 'instances', 'ram'} {{(pid=121340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:11:36.446025 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-a5e56c37-401d-4247-acb2-c1befcf951b0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Going to run 1 instances... {{(pid=121340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:11:36.450534 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-a5e56c37-401d-4247-acb2-c1befcf951b0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 8a8b6392-8237-47f3-9a9b-7a80f18f71c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9be77128-e763-4225-b76f-85fbb04ad9b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:11:36.664972 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-1b3890dd-934a-4a83-8ead-81430347d443 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:36.675630 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-1b3890dd-934a-4a83-8ead-81430347d443 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 929d6445-681f-48b3-b51f-495532864e64] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:36.676035 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-a5e56c37-401d-4247-acb2-c1befcf951b0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.477940 Sep 01 14:11:36.676035 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 377/739] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 1 14:11:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 1481 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 14:11:36.676353 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1b3890dd-934a-4a83-8ead-81430347d443 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:36.676884 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1b3890dd-934a-4a83-8ead-81430347d443 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:36.677323 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1b3890dd-934a-4a83-8ead-81430347d443 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:36.678078 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1b3890dd-934a-4a83-8ead-81430347d443 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:36.678535 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1b3890dd-934a-4a83-8ead-81430347d443 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:36.678957 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1b3890dd-934a-4a83-8ead-81430347d443 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:36.694750 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-ce790ab6-d8e0-44d5-9309-450e50eac8bb tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:36.696249 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-ce790ab6-d8e0-44d5-9309-450e50eac8bb tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 8a8b6392-8237-47f3-9a9b-7a80f18f71c3] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:36.809046 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-ce790ab6-d8e0-44d5-9309-450e50eac8bb tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:36.815672 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell0:SELECT=2 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:11:36.824333 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-ce790ab6-d8e0-44d5-9309-450e50eac8bb tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3" status: 200 len: 1236 microversion: 2.1 time: 0.132869 Sep 01 14:11:36.824333 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 378/740] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:36 2022] GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3 => generated 1236 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:36.829873 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.objects.instance [None req-1b3890dd-934a-4a83-8ead-81430347d443 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lazy-loading 'services' on Instance uuid 929d6445-681f-48b3-b51f-495532864e64 {{(pid=121339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:11:36.851354 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-422c3cd7-446d-447a-8483-115c4525aa53 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:36.852820 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-422c3cd7-446d-447a-8483-115c4525aa53 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:36.870371 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-422c3cd7-446d-447a-8483-115c4525aa53 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:36.870371 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-422c3cd7-446d-447a-8483-115c4525aa53 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:36.870371 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-422c3cd7-446d-447a-8483-115c4525aa53 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:36.871168 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-422c3cd7-446d-447a-8483-115c4525aa53 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:36.871772 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-422c3cd7-446d-447a-8483-115c4525aa53 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:36.872108 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-422c3cd7-446d-447a-8483-115c4525aa53 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:37.102160 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-422c3cd7-446d-447a-8483-115c4525aa53 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:37.115087 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-422c3cd7-446d-447a-8483-115c4525aa53 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1758 microversion: 2.1 time: 0.271945 Sep 01 14:11:37.116460 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 379/741] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:36 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1758 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:11:37.201735 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-1b3890dd-934a-4a83-8ead-81430347d443 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "DELETE /compute/v2.1/servers/929d6445-681f-48b3-b51f-495532864e64/os-volume_attachments/3ca2ff44-c2bf-417d-95c9-b1973c25ac97" status: 202 len: 0 microversion: 2.1 time: 0.546432 Sep 01 14:11:37.202566 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 363/742] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Sep 1 14:11:36 2022] DELETE /compute/v2.1/servers/929d6445-681f-48b3-b51f-495532864e64/os-volume_attachments/3ca2ff44-c2bf-417d-95c9-b1973c25ac97 => generated 0 bytes in 549 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 14:11:37.420080 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-54ee13c7-a815-4ed5-8f47-8a50976f139d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:37.420739 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-54ee13c7-a815-4ed5-8f47-8a50976f139d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:37.427785 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-54ee13c7-a815-4ed5-8f47-8a50976f139d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:37.428275 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-54ee13c7-a815-4ed5-8f47-8a50976f139d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:37.428700 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-54ee13c7-a815-4ed5-8f47-8a50976f139d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:37.429463 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-54ee13c7-a815-4ed5-8f47-8a50976f139d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:37.429937 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-54ee13c7-a815-4ed5-8f47-8a50976f139d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:37.430356 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-54ee13c7-a815-4ed5-8f47-8a50976f139d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:37.614541 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-54ee13c7-a815-4ed5-8f47-8a50976f139d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:37.623241 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-54ee13c7-a815-4ed5-8f47-8a50976f139d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce" status: 200 len: 1368 microversion: 2.1 time: 0.207070 Sep 01 14:11:37.623977 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 380/743] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:37 2022] GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce => generated 1368 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:37.855526 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-eeb5dca6-29f8-49a8-8aeb-8a225437cbb4 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:37.856434 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-eeb5dca6-29f8-49a8-8aeb-8a225437cbb4 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 8a8b6392-8237-47f3-9a9b-7a80f18f71c3] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:37.923914 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-eeb5dca6-29f8-49a8-8aeb-8a225437cbb4 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:37.933725 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-eeb5dca6-29f8-49a8-8aeb-8a225437cbb4 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3" status: 200 len: 1236 microversion: 2.1 time: 0.083613 Sep 01 14:11:37.936893 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 364/744] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:37 2022] GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3 => generated 1236 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:11:38.151425 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-4f461b5e-b427-4fe1-80ec-dcdc33397b7a tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:38.152224 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-4f461b5e-b427-4fe1-80ec-dcdc33397b7a tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:38.160492 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4f461b5e-b427-4fe1-80ec-dcdc33397b7a tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:38.161034 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4f461b5e-b427-4fe1-80ec-dcdc33397b7a tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:38.161560 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4f461b5e-b427-4fe1-80ec-dcdc33397b7a tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:38.162360 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4f461b5e-b427-4fe1-80ec-dcdc33397b7a tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:38.162955 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4f461b5e-b427-4fe1-80ec-dcdc33397b7a tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:38.163567 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4f461b5e-b427-4fe1-80ec-dcdc33397b7a tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:38.431673 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-4f461b5e-b427-4fe1-80ec-dcdc33397b7a tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:38.431673 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-4f461b5e-b427-4fe1-80ec-dcdc33397b7a tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1758 microversion: 2.1 time: 0.271166 Sep 01 14:11:38.431673 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 381/745] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:38 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1758 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:38.647282 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-b3dead75-419f-4228-8774-ba1edd2dd18b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:38.647897 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-b3dead75-419f-4228-8774-ba1edd2dd18b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:38.655584 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b3dead75-419f-4228-8774-ba1edd2dd18b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:38.656080 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b3dead75-419f-4228-8774-ba1edd2dd18b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:38.657222 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b3dead75-419f-4228-8774-ba1edd2dd18b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:38.658219 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b3dead75-419f-4228-8774-ba1edd2dd18b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:38.658687 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b3dead75-419f-4228-8774-ba1edd2dd18b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:38.659123 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b3dead75-419f-4228-8774-ba1edd2dd18b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:38.827540 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-b3dead75-419f-4228-8774-ba1edd2dd18b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:38.832747 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:11:38.841747 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-b3dead75-419f-4228-8774-ba1edd2dd18b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce" status: 200 len: 1368 microversion: 2.1 time: 0.199107 Sep 01 14:11:38.842598 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 365/746] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:38 2022] GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce => generated 1368 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:38.956943 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-f0cbb2b8-75b1-4883-8ff2-4a3f43413c32 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:38.957836 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-f0cbb2b8-75b1-4883-8ff2-4a3f43413c32 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 8a8b6392-8237-47f3-9a9b-7a80f18f71c3] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:38.965341 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f0cbb2b8-75b1-4883-8ff2-4a3f43413c32 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:38.965878 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f0cbb2b8-75b1-4883-8ff2-4a3f43413c32 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:38.966438 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f0cbb2b8-75b1-4883-8ff2-4a3f43413c32 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:38.967129 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f0cbb2b8-75b1-4883-8ff2-4a3f43413c32 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:38.967587 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f0cbb2b8-75b1-4883-8ff2-4a3f43413c32 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:38.968019 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f0cbb2b8-75b1-4883-8ff2-4a3f43413c32 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:39.077778 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-f0cbb2b8-75b1-4883-8ff2-4a3f43413c32 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:39.085296 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-f0cbb2b8-75b1-4883-8ff2-4a3f43413c32 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3" status: 200 len: 1240 microversion: 2.1 time: 0.133053 Sep 01 14:11:39.086758 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 382/747] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:38 2022] GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3 => generated 1240 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:11:39.445389 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-8283b9f8-3a4c-4386-8ac0-06a0194c41f1 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:39.446205 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-8283b9f8-3a4c-4386-8ac0-06a0194c41f1 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:39.455154 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8283b9f8-3a4c-4386-8ac0-06a0194c41f1 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:39.455654 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8283b9f8-3a4c-4386-8ac0-06a0194c41f1 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:39.456283 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8283b9f8-3a4c-4386-8ac0-06a0194c41f1 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:39.457017 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8283b9f8-3a4c-4386-8ac0-06a0194c41f1 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:39.457724 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8283b9f8-3a4c-4386-8ac0-06a0194c41f1 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:39.463266 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8283b9f8-3a4c-4386-8ac0-06a0194c41f1 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:39.736661 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-8283b9f8-3a4c-4386-8ac0-06a0194c41f1 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:39.748571 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-8283b9f8-3a4c-4386-8ac0-06a0194c41f1 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1758 microversion: 2.1 time: 0.308293 Sep 01 14:11:39.749219 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 366/748] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:39 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1758 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:11:39.870239 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-b68ad6bd-3e82-4bee-b462-5a0b1384e57f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:39.871355 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-b68ad6bd-3e82-4bee-b462-5a0b1384e57f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:39.882279 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b68ad6bd-3e82-4bee-b462-5a0b1384e57f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:39.883174 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b68ad6bd-3e82-4bee-b462-5a0b1384e57f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:39.883904 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b68ad6bd-3e82-4bee-b462-5a0b1384e57f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:39.885160 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b68ad6bd-3e82-4bee-b462-5a0b1384e57f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:39.886036 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b68ad6bd-3e82-4bee-b462-5a0b1384e57f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:39.886818 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b68ad6bd-3e82-4bee-b462-5a0b1384e57f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:40.043887 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-b68ad6bd-3e82-4bee-b462-5a0b1384e57f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:40.054030 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-b68ad6bd-3e82-4bee-b462-5a0b1384e57f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce" status: 200 len: 1368 microversion: 2.1 time: 0.191642 Sep 01 14:11:40.054768 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 383/749] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:39 2022] GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce => generated 1368 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:40.109000 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-7bdf203c-601d-45a6-b80a-5694e6730598 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:40.110350 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-7bdf203c-601d-45a6-b80a-5694e6730598 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 8a8b6392-8237-47f3-9a9b-7a80f18f71c3] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:40.116910 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7bdf203c-601d-45a6-b80a-5694e6730598 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:40.117403 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7bdf203c-601d-45a6-b80a-5694e6730598 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:40.117837 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7bdf203c-601d-45a6-b80a-5694e6730598 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:40.118574 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7bdf203c-601d-45a6-b80a-5694e6730598 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:40.119033 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7bdf203c-601d-45a6-b80a-5694e6730598 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:40.119460 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7bdf203c-601d-45a6-b80a-5694e6730598 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:40.210281 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-7bdf203c-601d-45a6-b80a-5694e6730598 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:40.225649 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-7bdf203c-601d-45a6-b80a-5694e6730598 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3" status: 200 len: 1288 microversion: 2.1 time: 0.120147 Sep 01 14:11:40.226837 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 367/750] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:40 2022] GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3 => generated 1288 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:40.513272 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-00591bf3-09d6-4d52-9dcf-ccdc3073f88c tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:40.514364 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-00591bf3-09d6-4d52-9dcf-ccdc3073f88c tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 929d6445-681f-48b3-b51f-495532864e64] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:40.523220 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-00591bf3-09d6-4d52-9dcf-ccdc3073f88c tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:40.523968 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-00591bf3-09d6-4d52-9dcf-ccdc3073f88c tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:40.524505 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-00591bf3-09d6-4d52-9dcf-ccdc3073f88c tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:40.526691 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-00591bf3-09d6-4d52-9dcf-ccdc3073f88c tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:40.527457 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-00591bf3-09d6-4d52-9dcf-ccdc3073f88c tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:40.527991 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-00591bf3-09d6-4d52-9dcf-ccdc3073f88c tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:40.571346 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-00591bf3-09d6-4d52-9dcf-ccdc3073f88c tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 929d6445-681f-48b3-b51f-495532864e64] Going to try to terminate instance {{(pid=121340) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:11:40.774691 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-22290099-d201-4762-b137-9a3cb06d1261 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:40.775719 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-22290099-d201-4762-b137-9a3cb06d1261 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:40.779043 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_api:SELECT=100 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:11:40.786373 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-22290099-d201-4762-b137-9a3cb06d1261 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:40.787216 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-22290099-d201-4762-b137-9a3cb06d1261 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:40.787744 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-22290099-d201-4762-b137-9a3cb06d1261 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:40.788660 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-22290099-d201-4762-b137-9a3cb06d1261 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:40.789696 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-22290099-d201-4762-b137-9a3cb06d1261 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:40.790337 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-22290099-d201-4762-b137-9a3cb06d1261 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:41.034568 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-22290099-d201-4762-b137-9a3cb06d1261 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:41.047692 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-22290099-d201-4762-b137-9a3cb06d1261 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1758 microversion: 2.1 time: 0.279512 Sep 01 14:11:41.048608 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 368/751] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:40 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1758 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:11:41.076681 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-7872ba62-266d-4161-b8ff-9064cd9af657 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:41.077477 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-7872ba62-266d-4161-b8ff-9064cd9af657 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:41.091267 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7872ba62-266d-4161-b8ff-9064cd9af657 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:41.097005 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7872ba62-266d-4161-b8ff-9064cd9af657 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:41.097215 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-00591bf3-09d6-4d52-9dcf-ccdc3073f88c tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "DELETE /compute/v2.1/servers/929d6445-681f-48b3-b51f-495532864e64" status: 204 len: 0 microversion: 2.1 time: 0.583463 Sep 01 14:11:41.097944 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7872ba62-266d-4161-b8ff-9064cd9af657 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:41.098102 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 384/752] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 14:11:40 2022] DELETE /compute/v2.1/servers/929d6445-681f-48b3-b51f-495532864e64 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:11:41.098613 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7872ba62-266d-4161-b8ff-9064cd9af657 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:41.098613 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7872ba62-266d-4161-b8ff-9064cd9af657 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:41.098613 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7872ba62-266d-4161-b8ff-9064cd9af657 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:41.106434 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-ffe9886c-c1df-4560-b6aa-3e1992b458ff tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:41.107160 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-ffe9886c-c1df-4560-b6aa-3e1992b458ff tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 929d6445-681f-48b3-b51f-495532864e64] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:41.139495 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ffe9886c-c1df-4560-b6aa-3e1992b458ff tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:41.139495 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ffe9886c-c1df-4560-b6aa-3e1992b458ff tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:41.139495 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ffe9886c-c1df-4560-b6aa-3e1992b458ff tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:41.139495 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ffe9886c-c1df-4560-b6aa-3e1992b458ff tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:41.140102 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ffe9886c-c1df-4560-b6aa-3e1992b458ff tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:41.140102 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ffe9886c-c1df-4560-b6aa-3e1992b458ff tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:41.374184 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-7872ba62-266d-4161-b8ff-9064cd9af657 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:41.393199 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-7872ba62-266d-4161-b8ff-9064cd9af657 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce" status: 200 len: 1368 microversion: 2.1 time: 0.321115 Sep 01 14:11:41.394512 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 369/753] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:41 2022] GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce => generated 1368 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:11:41.403702 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-38f68426-e0e3-421a-aa66-b1786c60f47a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:41.404863 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-38f68426-e0e3-421a-aa66-b1786c60f47a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 8a8b6392-8237-47f3-9a9b-7a80f18f71c3] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:41.417477 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-38f68426-e0e3-421a-aa66-b1786c60f47a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:41.418941 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-ffe9886c-c1df-4560-b6aa-3e1992b458ff tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53d275b44a2432a9fe8611304bcfa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d998735c243c3bcd08ca2e2d81ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:41.429157 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-38f68426-e0e3-421a-aa66-b1786c60f47a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:41.429671 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-38f68426-e0e3-421a-aa66-b1786c60f47a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:41.431200 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-38f68426-e0e3-421a-aa66-b1786c60f47a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:41.431791 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-38f68426-e0e3-421a-aa66-b1786c60f47a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:41.432469 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-38f68426-e0e3-421a-aa66-b1786c60f47a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:41.434956 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-ffe9886c-c1df-4560-b6aa-3e1992b458ff tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "GET /compute/v2.1/servers/929d6445-681f-48b3-b51f-495532864e64" status: 200 len: 1514 microversion: 2.1 time: 0.333698 Sep 01 14:11:41.436873 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 385/754] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:41 2022] GET /compute/v2.1/servers/929d6445-681f-48b3-b51f-495532864e64 => generated 1514 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:41.564822 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-38f68426-e0e3-421a-aa66-b1786c60f47a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:41.577436 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-38f68426-e0e3-421a-aa66-b1786c60f47a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3" status: 200 len: 1294 microversion: 2.1 time: 0.181017 Sep 01 14:11:41.590841 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 370/755] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:41 2022] GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3 => generated 1294 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:41.874779 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [req-e4b1b0d1-68c2-4f74-923a-c1992a7c7223 req-0b152891-b8dd-462c-a220-db135703d8d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce", "name": "network-vif-plugged", "status": "completed", "tag": "13cc93c3-c869-44c3-b869-955e63001656"}]} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:11:41.888312 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-e4b1b0d1-68c2-4f74-923a-c1992a7c7223 req-0b152891-b8dd-462c-a220-db135703d8d0 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:41.888805 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-e4b1b0d1-68c2-4f74-923a-c1992a7c7223 req-0b152891-b8dd-462c-a220-db135703d8d0 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:41.889249 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-e4b1b0d1-68c2-4f74-923a-c1992a7c7223 req-0b152891-b8dd-462c-a220-db135703d8d0 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:41.901683 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.compute.server_external_events [req-e4b1b0d1-68c2-4f74-923a-c1992a7c7223 req-0b152891-b8dd-462c-a220-db135703d8d0 service nova] Creating event network-vif-plugged:13cc93c3-c869-44c3-b869-955e63001656 for instance 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce on hv-cinder-85221 Sep 01 14:11:41.907494 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [req-e4b1b0d1-68c2-4f74-923a-c1992a7c7223 req-0b152891-b8dd-462c-a220-db135703d8d0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115724 Sep 01 14:11:41.908109 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 386/756] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:11:42.077827 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-cc7e1631-6b21-4c27-a453-b3be434dc0dd tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:42.079362 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-cc7e1631-6b21-4c27-a453-b3be434dc0dd tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:42.087163 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-cc7e1631-6b21-4c27-a453-b3be434dc0dd tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:42.088005 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-cc7e1631-6b21-4c27-a453-b3be434dc0dd tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:42.088452 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-cc7e1631-6b21-4c27-a453-b3be434dc0dd tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:42.089196 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-cc7e1631-6b21-4c27-a453-b3be434dc0dd tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:42.089656 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-cc7e1631-6b21-4c27-a453-b3be434dc0dd tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:42.090106 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-cc7e1631-6b21-4c27-a453-b3be434dc0dd tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:42.302542 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-cc7e1631-6b21-4c27-a453-b3be434dc0dd tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:42.318393 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-cc7e1631-6b21-4c27-a453-b3be434dc0dd tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1758 microversion: 2.1 time: 0.244736 Sep 01 14:11:42.319565 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 371/757] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:42 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1758 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:42.430259 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-c341bdd9-7df0-4705-80ab-c52424b07f1b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:42.430962 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-c341bdd9-7df0-4705-80ab-c52424b07f1b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:42.437599 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c341bdd9-7df0-4705-80ab-c52424b07f1b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:42.438122 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c341bdd9-7df0-4705-80ab-c52424b07f1b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:42.438560 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c341bdd9-7df0-4705-80ab-c52424b07f1b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:42.439276 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c341bdd9-7df0-4705-80ab-c52424b07f1b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:42.439729 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c341bdd9-7df0-4705-80ab-c52424b07f1b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:42.440154 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c341bdd9-7df0-4705-80ab-c52424b07f1b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:42.443353 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:11:42.470466 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-94c122bb-1a56-4695-b526-1390465afee2 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:42.471096 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-94c122bb-1a56-4695-b526-1390465afee2 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 929d6445-681f-48b3-b51f-495532864e64] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:42.478078 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-94c122bb-1a56-4695-b526-1390465afee2 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:42.478547 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-94c122bb-1a56-4695-b526-1390465afee2 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:42.478982 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-94c122bb-1a56-4695-b526-1390465afee2 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:42.479703 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-94c122bb-1a56-4695-b526-1390465afee2 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:42.480155 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-94c122bb-1a56-4695-b526-1390465afee2 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:42.480645 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-94c122bb-1a56-4695-b526-1390465afee2 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:42.678474 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-c341bdd9-7df0-4705-80ab-c52424b07f1b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:42.689222 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-c341bdd9-7df0-4705-80ab-c52424b07f1b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce" status: 200 len: 1368 microversion: 2.1 time: 0.263600 Sep 01 14:11:42.690222 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 387/758] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:42 2022] GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce => generated 1368 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:42.697155 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-593d2b95-8274-4a93-999a-4b8e50124df6 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:42.698208 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-593d2b95-8274-4a93-999a-4b8e50124df6 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 8a8b6392-8237-47f3-9a9b-7a80f18f71c3] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:42.709782 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-593d2b95-8274-4a93-999a-4b8e50124df6 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:42.714449 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-593d2b95-8274-4a93-999a-4b8e50124df6 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:42.715154 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-593d2b95-8274-4a93-999a-4b8e50124df6 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:42.715858 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-94c122bb-1a56-4695-b526-1390465afee2 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53d275b44a2432a9fe8611304bcfa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d998735c243c3bcd08ca2e2d81ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:42.716383 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-593d2b95-8274-4a93-999a-4b8e50124df6 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:42.717257 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-593d2b95-8274-4a93-999a-4b8e50124df6 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:42.717861 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-593d2b95-8274-4a93-999a-4b8e50124df6 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:42.755026 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-94c122bb-1a56-4695-b526-1390465afee2 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "GET /compute/v2.1/servers/929d6445-681f-48b3-b51f-495532864e64" status: 200 len: 1514 microversion: 2.1 time: 0.289336 Sep 01 14:11:42.756847 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 372/759] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:42 2022] GET /compute/v2.1/servers/929d6445-681f-48b3-b51f-495532864e64 => generated 1514 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:11:43.072463 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-593d2b95-8274-4a93-999a-4b8e50124df6 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:43.091043 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-593d2b95-8274-4a93-999a-4b8e50124df6 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3" status: 200 len: 1362 microversion: 2.1 time: 0.399135 Sep 01 14:11:43.092216 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 388/760] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:42 2022] GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3 => generated 1362 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:43.354735 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-f9d4373d-e9e2-44f1-842d-315379f12ae1 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:43.370522 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-f9d4373d-e9e2-44f1-842d-315379f12ae1 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:43.370522 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f9d4373d-e9e2-44f1-842d-315379f12ae1 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:43.370522 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f9d4373d-e9e2-44f1-842d-315379f12ae1 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:43.370522 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f9d4373d-e9e2-44f1-842d-315379f12ae1 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:43.371819 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f9d4373d-e9e2-44f1-842d-315379f12ae1 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:43.372651 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f9d4373d-e9e2-44f1-842d-315379f12ae1 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:43.373435 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f9d4373d-e9e2-44f1-842d-315379f12ae1 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:43.731197 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-a6705735-f96d-46ad-9e70-715c38625b33 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:43.732705 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-a6705735-f96d-46ad-9e70-715c38625b33 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:43.741587 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-f9d4373d-e9e2-44f1-842d-315379f12ae1 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:43.751495 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a6705735-f96d-46ad-9e70-715c38625b33 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:43.752794 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a6705735-f96d-46ad-9e70-715c38625b33 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:43.753787 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a6705735-f96d-46ad-9e70-715c38625b33 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:43.757086 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a6705735-f96d-46ad-9e70-715c38625b33 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:43.758462 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a6705735-f96d-46ad-9e70-715c38625b33 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:43.759699 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a6705735-f96d-46ad-9e70-715c38625b33 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:43.762229 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-f9d4373d-e9e2-44f1-842d-315379f12ae1 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1758 microversion: 2.1 time: 0.410806 Sep 01 14:11:43.793834 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 373/761] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:43 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1758 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:11:43.816897 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-7e872b05-ac01-4995-b282-e6f8fe287eea tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:43.818453 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-7e872b05-ac01-4995-b282-e6f8fe287eea tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 929d6445-681f-48b3-b51f-495532864e64] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:43.830505 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7e872b05-ac01-4995-b282-e6f8fe287eea tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:43.831824 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7e872b05-ac01-4995-b282-e6f8fe287eea tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:43.833122 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7e872b05-ac01-4995-b282-e6f8fe287eea tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:43.834939 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7e872b05-ac01-4995-b282-e6f8fe287eea tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:43.835888 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7e872b05-ac01-4995-b282-e6f8fe287eea tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:43.836896 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7e872b05-ac01-4995-b282-e6f8fe287eea tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:44.124279 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-a6705735-f96d-46ad-9e70-715c38625b33 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:44.135509 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-a6705735-f96d-46ad-9e70-715c38625b33 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce" status: 200 len: 1368 microversion: 2.1 time: 0.410804 Sep 01 14:11:44.136469 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 389/762] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:43 2022] GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce => generated 1368 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:11:44.179573 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-7e872b05-ac01-4995-b282-e6f8fe287eea tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53d275b44a2432a9fe8611304bcfa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d998735c243c3bcd08ca2e2d81ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:44.194941 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-7e872b05-ac01-4995-b282-e6f8fe287eea tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "GET /compute/v2.1/servers/929d6445-681f-48b3-b51f-495532864e64" status: 200 len: 1514 microversion: 2.1 time: 0.398948 Sep 01 14:11:44.196578 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 374/763] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:43 2022] GET /compute/v2.1/servers/929d6445-681f-48b3-b51f-495532864e64 => generated 1514 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:44.208006 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-58c840ee-6240-4978-8168-8f9655069b4e tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:44.209096 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-58c840ee-6240-4978-8168-8f9655069b4e tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 8a8b6392-8237-47f3-9a9b-7a80f18f71c3] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:44.220218 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-58c840ee-6240-4978-8168-8f9655069b4e tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:44.221030 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-58c840ee-6240-4978-8168-8f9655069b4e tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:44.221785 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-58c840ee-6240-4978-8168-8f9655069b4e tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:44.223150 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-58c840ee-6240-4978-8168-8f9655069b4e tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:44.224209 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-58c840ee-6240-4978-8168-8f9655069b4e tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:44.224925 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-58c840ee-6240-4978-8168-8f9655069b4e tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:44.232830 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [req-6e8d8948-3b2d-4de5-b0e9-fe121b32eda7 req-0bf4c843-2142-4f4f-a4b7-11a0d7894146 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "929d6445-681f-48b3-b51f-495532864e64", "name": "network-vif-deleted", "tag": "06ddaa56-ca0c-4c1e-81a3-7eb78cc5666e"}]} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:11:44.244336 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-6e8d8948-3b2d-4de5-b0e9-fe121b32eda7 req-0bf4c843-2142-4f4f-a4b7-11a0d7894146 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:44.244820 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-6e8d8948-3b2d-4de5-b0e9-fe121b32eda7 req-0bf4c843-2142-4f4f-a4b7-11a0d7894146 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:44.245245 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-6e8d8948-3b2d-4de5-b0e9-fe121b32eda7 req-0bf4c843-2142-4f4f-a4b7-11a0d7894146 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:44.258445 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.compute.server_external_events [req-6e8d8948-3b2d-4de5-b0e9-fe121b32eda7 req-0bf4c843-2142-4f4f-a4b7-11a0d7894146 service nova] Creating event network-vif-deleted:06ddaa56-ca0c-4c1e-81a3-7eb78cc5666e for instance 929d6445-681f-48b3-b51f-495532864e64 on hv-cinder-85221 Sep 01 14:11:44.263806 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [req-6e8d8948-3b2d-4de5-b0e9-fe121b32eda7 req-0bf4c843-2142-4f4f-a4b7-11a0d7894146 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125623 Sep 01 14:11:44.264410 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 390/764] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:11:44.334371 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [req-de4c9824-a0d9-4a92-a546-79b96e74d927 req-ad4917da-9287-4e60-9307-e60e4199eea0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a8b6392-8237-47f3-9a9b-7a80f18f71c3", "tag": "8eaab8ca-5a28-4ca2-ab32-f0a1392d34b7"}]} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:11:44.352072 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-de4c9824-a0d9-4a92-a546-79b96e74d927 req-ad4917da-9287-4e60-9307-e60e4199eea0 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:44.352957 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-de4c9824-a0d9-4a92-a546-79b96e74d927 req-ad4917da-9287-4e60-9307-e60e4199eea0 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:44.353752 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-de4c9824-a0d9-4a92-a546-79b96e74d927 req-ad4917da-9287-4e60-9307-e60e4199eea0 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:44.386235 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.compute.server_external_events [req-de4c9824-a0d9-4a92-a546-79b96e74d927 req-ad4917da-9287-4e60-9307-e60e4199eea0 service nova] Creating event network-changed:8eaab8ca-5a28-4ca2-ab32-f0a1392d34b7 for instance 8a8b6392-8237-47f3-9a9b-7a80f18f71c3 on hv-cinder-85221 Sep 01 14:11:44.394385 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [req-de4c9824-a0d9-4a92-a546-79b96e74d927 req-ad4917da-9287-4e60-9307-e60e4199eea0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068791 Sep 01 14:11:44.396506 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 391/765] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:11:44.449094 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-58c840ee-6240-4978-8168-8f9655069b4e tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:44.458959 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-58c840ee-6240-4978-8168-8f9655069b4e tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3" status: 200 len: 1362 microversion: 2.1 time: 0.259681 Sep 01 14:11:44.459558 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 375/766] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:44 2022] GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3 => generated 1362 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:44.801799 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-7a0831f1-b1cb-4ce8-8ee0-ec8a570f16f3 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:44.802563 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-7a0831f1-b1cb-4ce8-8ee0-ec8a570f16f3 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:44.809239 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7a0831f1-b1cb-4ce8-8ee0-ec8a570f16f3 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:44.809722 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7a0831f1-b1cb-4ce8-8ee0-ec8a570f16f3 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:44.810191 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7a0831f1-b1cb-4ce8-8ee0-ec8a570f16f3 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:44.810909 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7a0831f1-b1cb-4ce8-8ee0-ec8a570f16f3 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:44.811367 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7a0831f1-b1cb-4ce8-8ee0-ec8a570f16f3 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:44.811789 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7a0831f1-b1cb-4ce8-8ee0-ec8a570f16f3 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:44.981260 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-7a0831f1-b1cb-4ce8-8ee0-ec8a570f16f3 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:44.990782 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-7a0831f1-b1cb-4ce8-8ee0-ec8a570f16f3 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1761 microversion: 2.1 time: 0.193837 Sep 01 14:11:44.991369 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 392/767] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:44 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1761 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:11:45.172661 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-cac73c30-9721-4e27-8e5f-d2ffde2d2641 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:45.172661 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-cac73c30-9721-4e27-8e5f-d2ffde2d2641 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:45.178855 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-cac73c30-9721-4e27-8e5f-d2ffde2d2641 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:45.179344 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-cac73c30-9721-4e27-8e5f-d2ffde2d2641 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:45.179777 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-cac73c30-9721-4e27-8e5f-d2ffde2d2641 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:45.180527 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-cac73c30-9721-4e27-8e5f-d2ffde2d2641 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:45.180958 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-cac73c30-9721-4e27-8e5f-d2ffde2d2641 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:45.181381 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-cac73c30-9721-4e27-8e5f-d2ffde2d2641 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:45.226311 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-6d96ac6c-d926-4154-aed7-fe9299345ac2 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:45.233761 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-6d96ac6c-d926-4154-aed7-fe9299345ac2 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 929d6445-681f-48b3-b51f-495532864e64] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:45.246329 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:11:45.272676 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6d96ac6c-d926-4154-aed7-fe9299345ac2 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:45.274859 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6d96ac6c-d926-4154-aed7-fe9299345ac2 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:45.275796 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6d96ac6c-d926-4154-aed7-fe9299345ac2 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:45.277177 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6d96ac6c-d926-4154-aed7-fe9299345ac2 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:45.278272 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6d96ac6c-d926-4154-aed7-fe9299345ac2 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:45.279331 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6d96ac6c-d926-4154-aed7-fe9299345ac2 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:45.471252 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-6d96ac6c-d926-4154-aed7-fe9299345ac2 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53d275b44a2432a9fe8611304bcfa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d998735c243c3bcd08ca2e2d81ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:45.493419 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-6d96ac6c-d926-4154-aed7-fe9299345ac2 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "GET /compute/v2.1/servers/929d6445-681f-48b3-b51f-495532864e64" status: 200 len: 1303 microversion: 2.1 time: 0.274578 Sep 01 14:11:45.495218 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 393/768] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:45 2022] GET /compute/v2.1/servers/929d6445-681f-48b3-b51f-495532864e64 => generated 1303 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:45.503179 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-842b0e03-38a1-46c8-9a14-5ab1d627ca26 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:45.504749 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-842b0e03-38a1-46c8-9a14-5ab1d627ca26 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 8a8b6392-8237-47f3-9a9b-7a80f18f71c3] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:45.515020 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-842b0e03-38a1-46c8-9a14-5ab1d627ca26 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:45.515930 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-842b0e03-38a1-46c8-9a14-5ab1d627ca26 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:45.517014 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-842b0e03-38a1-46c8-9a14-5ab1d627ca26 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:45.518499 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-842b0e03-38a1-46c8-9a14-5ab1d627ca26 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:45.519433 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-842b0e03-38a1-46c8-9a14-5ab1d627ca26 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:45.520355 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-842b0e03-38a1-46c8-9a14-5ab1d627ca26 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:45.536744 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-cac73c30-9721-4e27-8e5f-d2ffde2d2641 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:45.550574 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-cac73c30-9721-4e27-8e5f-d2ffde2d2641 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce" status: 200 len: 1368 microversion: 2.1 time: 0.383704 Sep 01 14:11:45.560541 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 376/769] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:45 2022] GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce => generated 1368 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:45.695961 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-842b0e03-38a1-46c8-9a14-5ab1d627ca26 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:45.704908 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-842b0e03-38a1-46c8-9a14-5ab1d627ca26 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3" status: 200 len: 1362 microversion: 2.1 time: 0.208040 Sep 01 14:11:45.705761 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 394/770] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:45 2022] GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3 => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:46.538201 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-4ebb9808-44fc-498d-ba93-acc87eb4d098 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:46.539000 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-4ebb9808-44fc-498d-ba93-acc87eb4d098 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 929d6445-681f-48b3-b51f-495532864e64] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:46.545719 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4ebb9808-44fc-498d-ba93-acc87eb4d098 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:46.546238 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4ebb9808-44fc-498d-ba93-acc87eb4d098 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:46.546674 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4ebb9808-44fc-498d-ba93-acc87eb4d098 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:46.547978 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4ebb9808-44fc-498d-ba93-acc87eb4d098 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:46.548432 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4ebb9808-44fc-498d-ba93-acc87eb4d098 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:46.548857 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4ebb9808-44fc-498d-ba93-acc87eb4d098 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:46.578240 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-3c5bc77f-62b9-4090-8fad-79ee61549372 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:46.579664 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-3c5bc77f-62b9-4090-8fad-79ee61549372 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:46.584070 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell0:SELECT=4 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:11:46.596754 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3c5bc77f-62b9-4090-8fad-79ee61549372 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:46.598048 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3c5bc77f-62b9-4090-8fad-79ee61549372 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:46.600057 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3c5bc77f-62b9-4090-8fad-79ee61549372 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:46.600503 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3c5bc77f-62b9-4090-8fad-79ee61549372 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:46.601488 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3c5bc77f-62b9-4090-8fad-79ee61549372 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:46.602464 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3c5bc77f-62b9-4090-8fad-79ee61549372 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:46.609139 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4ebb9808-44fc-498d-ba93-acc87eb4d098 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:46.609139 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4ebb9808-44fc-498d-ba93-acc87eb4d098 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:46.610728 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4ebb9808-44fc-498d-ba93-acc87eb4d098 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:46.611533 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.objects.instance [None req-4ebb9808-44fc-498d-ba93-acc87eb4d098 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lazy-loading 'fault' on Instance uuid 929d6445-681f-48b3-b51f-495532864e64 {{(pid=121339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:11:46.695857 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-4ebb9808-44fc-498d-ba93-acc87eb4d098 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e53d275b44a2432a9fe8611304bcfa91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e6d998735c243c3bcd08ca2e2d81ae9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:46.710591 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-4ebb9808-44fc-498d-ba93-acc87eb4d098 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "GET /compute/v2.1/servers/929d6445-681f-48b3-b51f-495532864e64" status: 200 len: 1308 microversion: 2.1 time: 0.175965 Sep 01 14:11:46.722011 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 377/771] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:46 2022] GET /compute/v2.1/servers/929d6445-681f-48b3-b51f-495532864e64 => generated 1308 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:46.732190 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-4cd97cf0-ab17-4d25-8c87-ade203db8b4f tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:46.733332 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-4cd97cf0-ab17-4d25-8c87-ade203db8b4f tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 8a8b6392-8237-47f3-9a9b-7a80f18f71c3] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:46.744508 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4cd97cf0-ab17-4d25-8c87-ade203db8b4f tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:46.744996 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4cd97cf0-ab17-4d25-8c87-ade203db8b4f tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:46.745429 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4cd97cf0-ab17-4d25-8c87-ade203db8b4f tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:46.746405 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4cd97cf0-ab17-4d25-8c87-ade203db8b4f tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:46.746878 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4cd97cf0-ab17-4d25-8c87-ade203db8b4f tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:46.747308 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4cd97cf0-ab17-4d25-8c87-ade203db8b4f tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:46.815109 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell0:SELECT=24 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:11:46.879066 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-3c5bc77f-62b9-4090-8fad-79ee61549372 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:46.888142 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-3c5bc77f-62b9-4090-8fad-79ee61549372 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce" status: 200 len: 1559 microversion: 2.1 time: 0.317737 Sep 01 14:11:46.903109 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 395/772] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:46 2022] GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce => generated 1559 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:46.911419 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-f83e971e-9a7e-43ef-bb75-e2c9e4b0fb06 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:46.912202 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-f83e971e-9a7e-43ef-bb75-e2c9e4b0fb06 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:46.919084 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f83e971e-9a7e-43ef-bb75-e2c9e4b0fb06 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:46.919580 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f83e971e-9a7e-43ef-bb75-e2c9e4b0fb06 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:46.920019 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f83e971e-9a7e-43ef-bb75-e2c9e4b0fb06 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:46.920734 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f83e971e-9a7e-43ef-bb75-e2c9e4b0fb06 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:46.921185 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f83e971e-9a7e-43ef-bb75-e2c9e4b0fb06 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:46.921945 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f83e971e-9a7e-43ef-bb75-e2c9e4b0fb06 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:46.971280 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-4cd97cf0-ab17-4d25-8c87-ade203db8b4f tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:47.002169 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-4cd97cf0-ab17-4d25-8c87-ade203db8b4f tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3" status: 200 len: 1362 microversion: 2.1 time: 0.278720 Sep 01 14:11:47.012880 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 378/773] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:46 2022] GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3 => generated 1362 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:47.063922 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-f83e971e-9a7e-43ef-bb75-e2c9e4b0fb06 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.157078 Sep 01 14:11:47.070846 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 396/774] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Sep 1 14:11:46 2022] GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce/os-interface => generated 285 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:11:47.746127 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-8434d4ac-503d-4d5b-84af-51a46a04a717 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:47.746806 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-8434d4ac-503d-4d5b-84af-51a46a04a717 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] [instance: 929d6445-681f-48b3-b51f-495532864e64] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:47.754565 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8434d4ac-503d-4d5b-84af-51a46a04a717 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:47.755054 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8434d4ac-503d-4d5b-84af-51a46a04a717 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:47.755487 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8434d4ac-503d-4d5b-84af-51a46a04a717 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:47.756226 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8434d4ac-503d-4d5b-84af-51a46a04a717 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:47.756679 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8434d4ac-503d-4d5b-84af-51a46a04a717 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:47.757099 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8434d4ac-503d-4d5b-84af-51a46a04a717 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:47.772340 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.wsgi [None req-8434d4ac-503d-4d5b-84af-51a46a04a717 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] HTTP exception thrown: Instance 929d6445-681f-48b3-b51f-495532864e64 could not be found. Sep 01 14:11:47.774160 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-8434d4ac-503d-4d5b-84af-51a46a04a717 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Request method failure captured: Sep 01 14:11:47.774160 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: request: GET /compute/v2.1/servers/929d6445-681f-48b3-b51f-495532864e64 HTTP/1.1 Sep 01 14:11:47.774160 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept: application/json Sep 01 14:11:47.774160 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept-Encoding: identity Sep 01 14:11:47.774160 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Connection: close Sep 01 14:11:47.774160 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Length: 0 Sep 01 14:11:47.774160 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Type: application/json Sep 01 14:11:47.774160 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Host: 10.222.0.25 Sep 01 14:11:47.774160 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Openstack-System-Scope: None Sep 01 14:11:47.774160 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: User-Agent: python-urllib3/1.26.12 Sep 01 14:11:47.774160 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Auth-Token: gAAAAABjELzjEL45kBu57JcOMhdZVwX8Tzj_dwUxCCD8CHaWOSaeaAl3HeTTZKSArltoTBZ_eOIg3IYKvjCVLdQBKV-4knMNeR6qNTEUaPof_3m6ww0GhE6XpDW_NuH3FOT6ReURdop0YXGIoxI6K8dXBTpwPdCE3bUvEHf2gzfaoSiYMzlD1GE Sep 01 14:11:47.774160 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Id: None Sep 01 14:11:47.774160 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Name: None Sep 01 14:11:47.774160 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Identity-Status: Confirmed Sep 01 14:11:47.774160 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Is-Admin-Project: True Sep 01 14:11:47.774160 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Id: default Sep 01 14:11:47.774160 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Name: Default Sep 01 14:11:47.774160 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Id: 2e6d998735c243c3bcd08ca2e2d81ae9 Sep 01 14:11:47.774160 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Name: tempest-VolumesSnapshotTestJSON-127143842 Sep 01 14:11:47.774160 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Role: member,reader Sep 01 14:11:47.774160 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Roles: member,reader Sep 01 14:11:47.784574 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2e6d998735c243c3bcd08ca2e2d81ae9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/2e6d998735c243c3bcd08ca2e2d81ae9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/2e6d998735c243c3bcd08ca2e2d81ae9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_2e6d998735c243c3bcd08ca2e2d81ae9"}]}] Sep 01 14:11:47.784574 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant: tempest-VolumesSnapshotTestJSON-127143842 Sep 01 14:11:47.784574 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Id: 2e6d998735c243c3bcd08ca2e2d81ae9 Sep 01 14:11:47.784574 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-127143842 Sep 01 14:11:47.784574 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User: tempest-VolumesSnapshotTestJSON-127143842-project Sep 01 14:11:47.784574 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Id: default Sep 01 14:11:47.784574 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Name: Default Sep 01 14:11:47.784574 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Id: e53d275b44a2432a9fe8611304bcfa91 Sep 01 14:11:47.784574 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Name: tempest-VolumesSnapshotTestJSON-127143842-project Sep 01 14:11:47.784574 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: method: > Sep 01 14:11:47.784574 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: exception: Instance 929d6445-681f-48b3-b51f-495532864e64 could not be found. Sep 01 14:11:47.784574 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: action_args: {'id': '929d6445-681f-48b3-b51f-495532864e64'} Sep 01 14:11:47.785285 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:11:47.785285 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:11:47.785285 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:11:47.785285 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:11:47.785285 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:11:47.785285 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:11:47.785285 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:11:47.785285 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:11:47.785285 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:11:47.785285 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:11:47.785285 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 929d6445-681f-48b3-b51f-495532864e64 could not be found. Sep 01 14:11:47.785285 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:11:47.785285 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:11:47.785285 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:11:47.785285 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:11:47.785285 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:11:47.785285 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:11:47.785285 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:11:47.785285 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:11:47.785285 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:11:47.786606 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:11:47.786606 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:11:47.786606 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:11:47.786606 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:11:47.786606 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:11:47.786606 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:11:47.786606 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:11:47.786606 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 929d6445-681f-48b3-b51f-495532864e64 could not be found. Sep 01 14:11:47.786606 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:11:47.786606 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:11:47.786606 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:11:47.786606 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:11:47.786606 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:11:47.786606 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:11:47.786606 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:11:47.786606 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:11:47.786606 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 929d6445-681f-48b3-b51f-495532864e64 could not be found. Sep 01 14:11:47.786606 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:11:47.787680 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-8434d4ac-503d-4d5b-84af-51a46a04a717 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] Returning 404 to user: Instance 929d6445-681f-48b3-b51f-495532864e64 could not be found. {{(pid=121339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:11:47.787680 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-8434d4ac-503d-4d5b-84af-51a46a04a717 tempest-VolumesSnapshotTestJSON-127143842 tempest-VolumesSnapshotTestJSON-127143842-project] 10.222.0.25 "GET /compute/v2.1/servers/929d6445-681f-48b3-b51f-495532864e64" status: 404 len: 111 microversion: 2.1 time: 0.033497 Sep 01 14:11:47.787680 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 379/775] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:47 2022] GET /compute/v2.1/servers/929d6445-681f-48b3-b51f-495532864e64 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 14:11:48.049198 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-7640341c-7001-4b67-94a2-6e47ef6a90c2 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:48.050155 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-7640341c-7001-4b67-94a2-6e47ef6a90c2 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 8a8b6392-8237-47f3-9a9b-7a80f18f71c3] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:48.058465 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7640341c-7001-4b67-94a2-6e47ef6a90c2 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:48.059181 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7640341c-7001-4b67-94a2-6e47ef6a90c2 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:48.059823 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7640341c-7001-4b67-94a2-6e47ef6a90c2 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:48.065048 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7640341c-7001-4b67-94a2-6e47ef6a90c2 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:48.065048 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7640341c-7001-4b67-94a2-6e47ef6a90c2 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:48.065048 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7640341c-7001-4b67-94a2-6e47ef6a90c2 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:48.366990 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-7640341c-7001-4b67-94a2-6e47ef6a90c2 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:48.379850 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-7640341c-7001-4b67-94a2-6e47ef6a90c2 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3" status: 200 len: 1362 microversion: 2.1 time: 0.336049 Sep 01 14:11:48.380681 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 397/776] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:48 2022] GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3 => generated 1362 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:48.817122 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [req-2cf47d17-89c8-4e6e-aa02-9c318a852bc1 req-fb8c9f9b-f253-461b-9669-dd60493c9222 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce", "tag": "13cc93c3-c869-44c3-b869-955e63001656"}]} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:11:48.822271 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell0:SELECT=2 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:11:48.829332 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-2cf47d17-89c8-4e6e-aa02-9c318a852bc1 req-fb8c9f9b-f253-461b-9669-dd60493c9222 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:48.829869 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-2cf47d17-89c8-4e6e-aa02-9c318a852bc1 req-fb8c9f9b-f253-461b-9669-dd60493c9222 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:48.830325 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-2cf47d17-89c8-4e6e-aa02-9c318a852bc1 req-fb8c9f9b-f253-461b-9669-dd60493c9222 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:48.842867 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.compute.server_external_events [req-2cf47d17-89c8-4e6e-aa02-9c318a852bc1 req-fb8c9f9b-f253-461b-9669-dd60493c9222 service nova] Creating event network-changed:13cc93c3-c869-44c3-b869-955e63001656 for instance 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce on hv-cinder-85221 Sep 01 14:11:48.849148 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [req-2cf47d17-89c8-4e6e-aa02-9c318a852bc1 req-fb8c9f9b-f253-461b-9669-dd60493c9222 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036176 Sep 01 14:11:48.849740 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 380/777] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:11:49.410729 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-f9f43eea-2691-40ce-aa78-2d570988814d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:49.413170 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-f9f43eea-2691-40ce-aa78-2d570988814d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 8a8b6392-8237-47f3-9a9b-7a80f18f71c3] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:49.428866 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f9f43eea-2691-40ce-aa78-2d570988814d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:49.430785 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f9f43eea-2691-40ce-aa78-2d570988814d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:49.431937 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f9f43eea-2691-40ce-aa78-2d570988814d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:49.433765 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f9f43eea-2691-40ce-aa78-2d570988814d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:49.435126 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f9f43eea-2691-40ce-aa78-2d570988814d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:49.436293 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f9f43eea-2691-40ce-aa78-2d570988814d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:49.713941 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-f9f43eea-2691-40ce-aa78-2d570988814d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:49.739601 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-f9f43eea-2691-40ce-aa78-2d570988814d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3" status: 200 len: 1362 microversion: 2.1 time: 0.336678 Sep 01 14:11:49.754042 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 398/778] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:49 2022] GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3 => generated 1362 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:50.767513 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-fe7ffafe-44fa-47bc-8fb8-db88400c88dd tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:50.768331 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-fe7ffafe-44fa-47bc-8fb8-db88400c88dd tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 8a8b6392-8237-47f3-9a9b-7a80f18f71c3] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:50.775564 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fe7ffafe-44fa-47bc-8fb8-db88400c88dd tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:50.776110 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fe7ffafe-44fa-47bc-8fb8-db88400c88dd tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:50.776720 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fe7ffafe-44fa-47bc-8fb8-db88400c88dd tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:50.777609 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fe7ffafe-44fa-47bc-8fb8-db88400c88dd tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:50.778177 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fe7ffafe-44fa-47bc-8fb8-db88400c88dd tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:50.778654 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fe7ffafe-44fa-47bc-8fb8-db88400c88dd tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:50.938641 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-fe7ffafe-44fa-47bc-8fb8-db88400c88dd tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:50.946939 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-fe7ffafe-44fa-47bc-8fb8-db88400c88dd tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3" status: 200 len: 1362 microversion: 2.1 time: 0.185601 Sep 01 14:11:50.947526 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 381/779] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:50 2022] GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3 => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:51.981451 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-f0959941-953c-44ae-8277-b14a462983b0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:51.982209 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-f0959941-953c-44ae-8277-b14a462983b0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 8a8b6392-8237-47f3-9a9b-7a80f18f71c3] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:51.989549 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f0959941-953c-44ae-8277-b14a462983b0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:51.990147 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f0959941-953c-44ae-8277-b14a462983b0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:51.990708 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f0959941-953c-44ae-8277-b14a462983b0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:51.991559 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f0959941-953c-44ae-8277-b14a462983b0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:51.992073 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f0959941-953c-44ae-8277-b14a462983b0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:51.992542 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f0959941-953c-44ae-8277-b14a462983b0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:52.166199 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-f0959941-953c-44ae-8277-b14a462983b0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:52.175488 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-f0959941-953c-44ae-8277-b14a462983b0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3" status: 200 len: 1362 microversion: 2.1 time: 0.198332 Sep 01 14:11:52.176070 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 399/780] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:51 2022] GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3 => generated 1362 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:53.210109 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-db1bbcbd-3acc-4b2f-b2e2-f3685bd16932 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:53.210714 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-db1bbcbd-3acc-4b2f-b2e2-f3685bd16932 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 8a8b6392-8237-47f3-9a9b-7a80f18f71c3] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:53.217669 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-db1bbcbd-3acc-4b2f-b2e2-f3685bd16932 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:53.218189 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-db1bbcbd-3acc-4b2f-b2e2-f3685bd16932 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:53.219210 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-db1bbcbd-3acc-4b2f-b2e2-f3685bd16932 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:53.220344 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-db1bbcbd-3acc-4b2f-b2e2-f3685bd16932 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:53.222055 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-db1bbcbd-3acc-4b2f-b2e2-f3685bd16932 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:53.222525 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-db1bbcbd-3acc-4b2f-b2e2-f3685bd16932 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:53.379787 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-db1bbcbd-3acc-4b2f-b2e2-f3685bd16932 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:53.388329 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-db1bbcbd-3acc-4b2f-b2e2-f3685bd16932 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3" status: 200 len: 1362 microversion: 2.1 time: 0.182396 Sep 01 14:11:53.389043 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 382/781] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:53 2022] GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3 => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:11:54.094374 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [req-7ee0fa0d-65ee-43a4-b8ab-01403e5aef65 req-63bf64da-e3fe-41fc-9a71-046983927b49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a8b6392-8237-47f3-9a9b-7a80f18f71c3", "name": "network-vif-plugged", "status": "completed", "tag": "8eaab8ca-5a28-4ca2-ab32-f0a1392d34b7"}]} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:11:54.105585 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-7ee0fa0d-65ee-43a4-b8ab-01403e5aef65 req-63bf64da-e3fe-41fc-9a71-046983927b49 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:54.106305 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-7ee0fa0d-65ee-43a4-b8ab-01403e5aef65 req-63bf64da-e3fe-41fc-9a71-046983927b49 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:54.106790 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-7ee0fa0d-65ee-43a4-b8ab-01403e5aef65 req-63bf64da-e3fe-41fc-9a71-046983927b49 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:54.120736 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.compute.server_external_events [req-7ee0fa0d-65ee-43a4-b8ab-01403e5aef65 req-63bf64da-e3fe-41fc-9a71-046983927b49 service nova] Creating event network-vif-plugged:8eaab8ca-5a28-4ca2-ab32-f0a1392d34b7 for instance 8a8b6392-8237-47f3-9a9b-7a80f18f71c3 on hv-cinder-85221 Sep 01 14:11:54.126895 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [req-7ee0fa0d-65ee-43a4-b8ab-01403e5aef65 req-63bf64da-e3fe-41fc-9a71-046983927b49 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039809 Sep 01 14:11:54.128875 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 400/782] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:11:54.454600 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-8ce5c2d1-6458-4bfe-929e-f68582c36bb6 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:54.454600 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-8ce5c2d1-6458-4bfe-929e-f68582c36bb6 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 8a8b6392-8237-47f3-9a9b-7a80f18f71c3] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:54.454600 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8ce5c2d1-6458-4bfe-929e-f68582c36bb6 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:54.454600 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8ce5c2d1-6458-4bfe-929e-f68582c36bb6 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:54.455824 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8ce5c2d1-6458-4bfe-929e-f68582c36bb6 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:54.455824 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8ce5c2d1-6458-4bfe-929e-f68582c36bb6 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:54.455824 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8ce5c2d1-6458-4bfe-929e-f68582c36bb6 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:54.455824 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8ce5c2d1-6458-4bfe-929e-f68582c36bb6 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:54.456447 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell1:SELECT=100 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:11:54.587801 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-8ce5c2d1-6458-4bfe-929e-f68582c36bb6 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:54.597958 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-8ce5c2d1-6458-4bfe-929e-f68582c36bb6 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3" status: 200 len: 1362 microversion: 2.1 time: 0.189949 Sep 01 14:11:54.598564 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 383/783] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:54 2022] GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3 => generated 1362 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:11:55.622517 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-b5ff39c0-e03b-44dd-acb3-c4e602091a5b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:55.623273 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-b5ff39c0-e03b-44dd-acb3-c4e602091a5b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 8a8b6392-8237-47f3-9a9b-7a80f18f71c3] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:55.631512 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b5ff39c0-e03b-44dd-acb3-c4e602091a5b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:55.632007 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b5ff39c0-e03b-44dd-acb3-c4e602091a5b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:55.632451 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b5ff39c0-e03b-44dd-acb3-c4e602091a5b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:55.633172 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b5ff39c0-e03b-44dd-acb3-c4e602091a5b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:55.633632 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b5ff39c0-e03b-44dd-acb3-c4e602091a5b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:55.634093 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b5ff39c0-e03b-44dd-acb3-c4e602091a5b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:55.794594 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-b5ff39c0-e03b-44dd-acb3-c4e602091a5b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:55.804348 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-b5ff39c0-e03b-44dd-acb3-c4e602091a5b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3" status: 200 len: 1362 microversion: 2.1 time: 0.186843 Sep 01 14:11:55.805044 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 401/784] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:55 2022] GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3 => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:56.826991 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-51cab25c-a53c-4402-8c92-b64f5bd8eb8a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:56.827953 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-51cab25c-a53c-4402-8c92-b64f5bd8eb8a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 8a8b6392-8237-47f3-9a9b-7a80f18f71c3] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:56.836571 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-51cab25c-a53c-4402-8c92-b64f5bd8eb8a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:56.837163 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-51cab25c-a53c-4402-8c92-b64f5bd8eb8a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:56.837686 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-51cab25c-a53c-4402-8c92-b64f5bd8eb8a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:56.838565 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-51cab25c-a53c-4402-8c92-b64f5bd8eb8a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:56.839199 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-51cab25c-a53c-4402-8c92-b64f5bd8eb8a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:56.839936 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-51cab25c-a53c-4402-8c92-b64f5bd8eb8a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:57.029004 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-51cab25c-a53c-4402-8c92-b64f5bd8eb8a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:57.041971 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-51cab25c-a53c-4402-8c92-b64f5bd8eb8a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3" status: 200 len: 1362 microversion: 2.1 time: 0.218677 Sep 01 14:11:57.043033 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 384/785] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:56 2022] GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3 => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:58.069713 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-5240e780-ab30-4f09-8c56-b033fcf1c8b1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:58.069713 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-5240e780-ab30-4f09-8c56-b033fcf1c8b1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 8a8b6392-8237-47f3-9a9b-7a80f18f71c3] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:58.074036 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5240e780-ab30-4f09-8c56-b033fcf1c8b1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:58.074538 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5240e780-ab30-4f09-8c56-b033fcf1c8b1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:58.074954 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5240e780-ab30-4f09-8c56-b033fcf1c8b1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:58.075687 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5240e780-ab30-4f09-8c56-b033fcf1c8b1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:58.076147 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5240e780-ab30-4f09-8c56-b033fcf1c8b1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:58.076572 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5240e780-ab30-4f09-8c56-b033fcf1c8b1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:58.225836 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-5240e780-ab30-4f09-8c56-b033fcf1c8b1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:58.234311 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-5240e780-ab30-4f09-8c56-b033fcf1c8b1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3" status: 200 len: 1547 microversion: 2.1 time: 0.173413 Sep 01 14:11:58.234971 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 402/786] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:58 2022] GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3 => generated 1547 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:58.260955 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-4208a680-be87-4937-8929-811fb317d120 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:58.261546 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-4208a680-be87-4937-8929-811fb317d120 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 8a8b6392-8237-47f3-9a9b-7a80f18f71c3] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:58.269575 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4208a680-be87-4937-8929-811fb317d120 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:58.270101 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4208a680-be87-4937-8929-811fb317d120 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:58.270535 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4208a680-be87-4937-8929-811fb317d120 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:58.271241 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4208a680-be87-4937-8929-811fb317d120 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:58.271692 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4208a680-be87-4937-8929-811fb317d120 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:58.272112 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4208a680-be87-4937-8929-811fb317d120 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:58.367680 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-4208a680-be87-4937-8929-811fb317d120 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107900 Sep 01 14:11:58.367680 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 385/787] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Sep 1 14:11:58 2022] GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:11:59.733861 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [req-6fa85bda-128d-4663-bc16-1df212d9ee57 req-acdec160-ef95-4862-87a0-d75039fcb92f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a8b6392-8237-47f3-9a9b-7a80f18f71c3", "tag": "8eaab8ca-5a28-4ca2-ab32-f0a1392d34b7"}]} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:11:59.753042 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-6fa85bda-128d-4663-bc16-1df212d9ee57 req-acdec160-ef95-4862-87a0-d75039fcb92f service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:59.753925 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-6fa85bda-128d-4663-bc16-1df212d9ee57 req-acdec160-ef95-4862-87a0-d75039fcb92f service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:59.754744 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-6fa85bda-128d-4663-bc16-1df212d9ee57 req-acdec160-ef95-4862-87a0-d75039fcb92f service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:59.775897 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.compute.server_external_events [req-6fa85bda-128d-4663-bc16-1df212d9ee57 req-acdec160-ef95-4862-87a0-d75039fcb92f service nova] Creating event network-changed:8eaab8ca-5a28-4ca2-ab32-f0a1392d34b7 for instance 8a8b6392-8237-47f3-9a9b-7a80f18f71c3 on hv-cinder-85221 Sep 01 14:11:59.785360 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [req-6fa85bda-128d-4663-bc16-1df212d9ee57 req-acdec160-ef95-4862-87a0-d75039fcb92f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058704 Sep 01 14:11:59.786621 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 403/788] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:12:08.352206 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_api:SELECT=37 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:12:08.356303 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell1:SELECT=13 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:12:08.360703 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-7d50d183-943a-44ff-9c9c-7e5afae5f600 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:08.361493 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-7d50d183-943a-44ff-9c9c-7e5afae5f600 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:08.369064 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7d50d183-943a-44ff-9c9c-7e5afae5f600 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:08.369605 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7d50d183-943a-44ff-9c9c-7e5afae5f600 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:08.370178 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7d50d183-943a-44ff-9c9c-7e5afae5f600 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:08.370894 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7d50d183-943a-44ff-9c9c-7e5afae5f600 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:08.371349 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7d50d183-943a-44ff-9c9c-7e5afae5f600 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:08.371775 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7d50d183-943a-44ff-9c9c-7e5afae5f600 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:08.467858 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.objects.instance [None req-7d50d183-943a-44ff-9c9c-7e5afae5f600 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lazy-loading 'services' on Instance uuid 1988647a-695e-49b8-a5d3-dd6c93c10ae5 {{(pid=121339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:12:08.689002 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-7d50d183-943a-44ff-9c9c-7e5afae5f600 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5/os-volume_attachments/69297810-f373-4ebd-8c92-aca5c1c0ef59" status: 202 len: 0 microversion: 2.1 time: 0.339069 Sep 01 14:12:08.689802 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 386/789] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Sep 1 14:12:08 2022] DELETE /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5/os-volume_attachments/69297810-f373-4ebd-8c92-aca5c1c0ef59 => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:12:08.701276 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-8b2f9cdf-a7b1-413c-a5f4-e174804e15d2 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:08.705452 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-8b2f9cdf-a7b1-413c-a5f4-e174804e15d2 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:08.714107 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8b2f9cdf-a7b1-413c-a5f4-e174804e15d2 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:08.714769 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8b2f9cdf-a7b1-413c-a5f4-e174804e15d2 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:08.715344 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8b2f9cdf-a7b1-413c-a5f4-e174804e15d2 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:08.716235 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8b2f9cdf-a7b1-413c-a5f4-e174804e15d2 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:08.716811 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8b2f9cdf-a7b1-413c-a5f4-e174804e15d2 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:08.717354 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8b2f9cdf-a7b1-413c-a5f4-e174804e15d2 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:08.757745 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-8b2f9cdf-a7b1-413c-a5f4-e174804e15d2 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062084 Sep 01 14:12:08.758379 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 404/790] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 14:12:08 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:12:09.773193 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-de21bbf6-84f5-4194-ad5d-d519b08d23e1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:09.775690 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-de21bbf6-84f5-4194-ad5d-d519b08d23e1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:09.783019 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-de21bbf6-84f5-4194-ad5d-d519b08d23e1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:09.783513 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-de21bbf6-84f5-4194-ad5d-d519b08d23e1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:09.783968 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-de21bbf6-84f5-4194-ad5d-d519b08d23e1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:09.784844 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-de21bbf6-84f5-4194-ad5d-d519b08d23e1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:09.785311 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-de21bbf6-84f5-4194-ad5d-d519b08d23e1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:09.785742 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-de21bbf6-84f5-4194-ad5d-d519b08d23e1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:09.821204 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-de21bbf6-84f5-4194-ad5d-d519b08d23e1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053203 Sep 01 14:12:09.821890 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 387/791] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 14:12:09 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:12:10.835083 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-d35c1b9a-6f16-4924-93fc-d891664b18db tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:10.837350 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-d35c1b9a-6f16-4924-93fc-d891664b18db tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:10.850176 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d35c1b9a-6f16-4924-93fc-d891664b18db tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:10.850176 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d35c1b9a-6f16-4924-93fc-d891664b18db tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:10.850176 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d35c1b9a-6f16-4924-93fc-d891664b18db tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:10.850176 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d35c1b9a-6f16-4924-93fc-d891664b18db tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:10.850808 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d35c1b9a-6f16-4924-93fc-d891664b18db tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:10.850808 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d35c1b9a-6f16-4924-93fc-d891664b18db tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:10.882068 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-d35c1b9a-6f16-4924-93fc-d891664b18db tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051612 Sep 01 14:12:10.882675 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 405/792] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 14:12:10 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 14:12:11.003819 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-f12396d2-ec19-4ac0-b7f1-34eaee218ca2 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:11.004547 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-f12396d2-ec19-4ac0-b7f1-34eaee218ca2 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:11.010852 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f12396d2-ec19-4ac0-b7f1-34eaee218ca2 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:11.011341 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f12396d2-ec19-4ac0-b7f1-34eaee218ca2 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:11.011898 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f12396d2-ec19-4ac0-b7f1-34eaee218ca2 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:11.012613 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f12396d2-ec19-4ac0-b7f1-34eaee218ca2 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:11.013071 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f12396d2-ec19-4ac0-b7f1-34eaee218ca2 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:11.013489 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f12396d2-ec19-4ac0-b7f1-34eaee218ca2 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:11.043230 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-f12396d2-ec19-4ac0-b7f1-34eaee218ca2 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Going to try to terminate instance {{(pid=121339) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:12:11.370543 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-c32e1aed-21a8-41fa-aabd-c08968621e39 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:11.371352 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-c32e1aed-21a8-41fa-aabd-c08968621e39 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:11.379911 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c32e1aed-21a8-41fa-aabd-c08968621e39 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:11.380511 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c32e1aed-21a8-41fa-aabd-c08968621e39 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:11.381056 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c32e1aed-21a8-41fa-aabd-c08968621e39 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:11.382349 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c32e1aed-21a8-41fa-aabd-c08968621e39 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:11.383184 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c32e1aed-21a8-41fa-aabd-c08968621e39 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:11.383634 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c32e1aed-21a8-41fa-aabd-c08968621e39 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:11.414713 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-c32e1aed-21a8-41fa-aabd-c08968621e39 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1/ips" status: 200 len: 151 microversion: 2.20 time: 0.050563 Sep 01 14:12:11.415722 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 406/793] 10.222.0.25 () {60 vars in 1289 bytes} [Thu Sep 1 14:12:11 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1/ips => generated 151 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 14:12:11.593080 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-f12396d2-ec19-4ac0-b7f1-34eaee218ca2 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 204 len: 0 microversion: 2.1 time: 0.593612 Sep 01 14:12:11.594565 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 388/794] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 14:12:10 2022] DELETE /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:12:11.607843 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-53fcd30b-79b5-4f28-b664-f47c120e2b73 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:11.609503 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-53fcd30b-79b5-4f28-b664-f47c120e2b73 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:11.616673 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-53fcd30b-79b5-4f28-b664-f47c120e2b73 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:11.617223 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-53fcd30b-79b5-4f28-b664-f47c120e2b73 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:11.617703 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-53fcd30b-79b5-4f28-b664-f47c120e2b73 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:11.618758 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-53fcd30b-79b5-4f28-b664-f47c120e2b73 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:11.619348 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-53fcd30b-79b5-4f28-b664-f47c120e2b73 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:11.619800 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-53fcd30b-79b5-4f28-b664-f47c120e2b73 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:11.623416 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell1:SELECT=100 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:12:11.796321 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-53fcd30b-79b5-4f28-b664-f47c120e2b73 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:11.805767 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-53fcd30b-79b5-4f28-b664-f47c120e2b73 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1688 microversion: 2.1 time: 0.204793 Sep 01 14:12:11.806383 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 407/795] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:11 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1688 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:12:12.830179 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-9d5055fe-8188-4cf8-b669-1e6a5e23f65b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:12.830915 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-9d5055fe-8188-4cf8-b669-1e6a5e23f65b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:12.838258 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9d5055fe-8188-4cf8-b669-1e6a5e23f65b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:12.838759 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9d5055fe-8188-4cf8-b669-1e6a5e23f65b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:12.839201 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9d5055fe-8188-4cf8-b669-1e6a5e23f65b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:12.839933 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9d5055fe-8188-4cf8-b669-1e6a5e23f65b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:12.840468 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9d5055fe-8188-4cf8-b669-1e6a5e23f65b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:12.840898 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9d5055fe-8188-4cf8-b669-1e6a5e23f65b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:13.057291 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-9d5055fe-8188-4cf8-b669-1e6a5e23f65b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:13.071432 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-9d5055fe-8188-4cf8-b669-1e6a5e23f65b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1688 microversion: 2.1 time: 0.246218 Sep 01 14:12:13.072446 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 389/796] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:12 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1688 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:12:13.946338 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-d77ed7cc-3195-4607-b82d-f8e74a75b1bd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:12:13.947167 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-d77ed7cc-3195-4607-b82d-f8e74a75b1bd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:13.954941 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d77ed7cc-3195-4607-b82d-f8e74a75b1bd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:13.955433 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d77ed7cc-3195-4607-b82d-f8e74a75b1bd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:13.955879 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d77ed7cc-3195-4607-b82d-f8e74a75b1bd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:13.956588 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d77ed7cc-3195-4607-b82d-f8e74a75b1bd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:13.957052 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d77ed7cc-3195-4607-b82d-f8e74a75b1bd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:13.957729 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d77ed7cc-3195-4607-b82d-f8e74a75b1bd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:13.986051 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.objects.instance [None req-d77ed7cc-3195-4607-b82d-f8e74a75b1bd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lazy-loading 'flavor' on Instance uuid d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 {{(pid=121340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:12:14.096071 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-56ebd7ea-d8d4-4df8-832e-e14da7a0ff2e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:14.097069 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-56ebd7ea-d8d4-4df8-832e-e14da7a0ff2e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:14.104705 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-56ebd7ea-d8d4-4df8-832e-e14da7a0ff2e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:14.105349 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-56ebd7ea-d8d4-4df8-832e-e14da7a0ff2e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:14.105887 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-56ebd7ea-d8d4-4df8-832e-e14da7a0ff2e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:14.106744 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-56ebd7ea-d8d4-4df8-832e-e14da7a0ff2e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:14.107300 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-56ebd7ea-d8d4-4df8-832e-e14da7a0ff2e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:14.107832 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-56ebd7ea-d8d4-4df8-832e-e14da7a0ff2e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:14.299670 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-56ebd7ea-d8d4-4df8-832e-e14da7a0ff2e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:14.308411 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-56ebd7ea-d8d4-4df8-832e-e14da7a0ff2e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1688 microversion: 2.1 time: 0.217541 Sep 01 14:12:14.310167 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 390/797] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:14 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1688 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:12:14.559467 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-d77ed7cc-3195-4607-b82d-f8e74a75b1bd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "POST /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1/action" status: 202 len: 0 microversion: 2.20 time: 0.617378 Sep 01 14:12:14.560099 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 408/798] 10.222.0.25 () {62 vars in 1319 bytes} [Thu Sep 1 14:12:13 2022] POST /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1/action => generated 0 bytes in 619 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 01 14:12:14.569251 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-707905c6-3df6-4015-8967-212737623572 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:14.569870 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-707905c6-3df6-4015-8967-212737623572 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:14.579286 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-707905c6-3df6-4015-8967-212737623572 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:14.580054 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-707905c6-3df6-4015-8967-212737623572 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:14.580892 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-707905c6-3df6-4015-8967-212737623572 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:14.582740 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-707905c6-3df6-4015-8967-212737623572 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:14.583557 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-707905c6-3df6-4015-8967-212737623572 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:14.584655 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-707905c6-3df6-4015-8967-212737623572 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:14.768505 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-707905c6-3df6-4015-8967-212737623572 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:14.781275 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-707905c6-3df6-4015-8967-212737623572 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:14.784059 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-707905c6-3df6-4015-8967-212737623572 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:14.786297 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-707905c6-3df6-4015-8967-212737623572 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1722 microversion: 2.20 time: 0.220992 Sep 01 14:12:14.787315 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 391/799] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:12:14 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:12:15.338028 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-25970687-7ad4-4518-a952-ed66fda25abd tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:15.338753 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-25970687-7ad4-4518-a952-ed66fda25abd tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:15.347211 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-25970687-7ad4-4518-a952-ed66fda25abd tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:15.347705 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-25970687-7ad4-4518-a952-ed66fda25abd tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:15.348145 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-25970687-7ad4-4518-a952-ed66fda25abd tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:15.348870 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-25970687-7ad4-4518-a952-ed66fda25abd tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:15.349330 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-25970687-7ad4-4518-a952-ed66fda25abd tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:15.349755 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-25970687-7ad4-4518-a952-ed66fda25abd tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:15.527793 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-25970687-7ad4-4518-a952-ed66fda25abd tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:15.537258 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-25970687-7ad4-4518-a952-ed66fda25abd tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1688 microversion: 2.1 time: 0.204467 Sep 01 14:12:15.537857 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 409/800] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:15 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1688 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:12:15.812357 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-c352becf-b268-498d-a6d4-385bd31d46f9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:15.813731 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-c352becf-b268-498d-a6d4-385bd31d46f9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:15.821404 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c352becf-b268-498d-a6d4-385bd31d46f9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:15.821934 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c352becf-b268-498d-a6d4-385bd31d46f9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:15.822393 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c352becf-b268-498d-a6d4-385bd31d46f9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:15.823161 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c352becf-b268-498d-a6d4-385bd31d46f9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:15.823618 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c352becf-b268-498d-a6d4-385bd31d46f9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:15.824055 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c352becf-b268-498d-a6d4-385bd31d46f9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:15.985278 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-c352becf-b268-498d-a6d4-385bd31d46f9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:15.997085 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-c352becf-b268-498d-a6d4-385bd31d46f9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:15.999199 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-c352becf-b268-498d-a6d4-385bd31d46f9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:16.001650 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-c352becf-b268-498d-a6d4-385bd31d46f9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1722 microversion: 2.20 time: 0.193219 Sep 01 14:12:16.001947 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 392/801] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:12:15 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:12:16.562988 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-4912f02e-34bf-4558-baa8-b9c927ef9262 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:16.565331 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-4912f02e-34bf-4558-baa8-b9c927ef9262 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:16.569231 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_api:SELECT=34 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:12:16.577139 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4912f02e-34bf-4558-baa8-b9c927ef9262 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:16.578036 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4912f02e-34bf-4558-baa8-b9c927ef9262 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:16.578847 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4912f02e-34bf-4558-baa8-b9c927ef9262 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:16.580009 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4912f02e-34bf-4558-baa8-b9c927ef9262 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:16.580747 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4912f02e-34bf-4558-baa8-b9c927ef9262 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:16.581475 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4912f02e-34bf-4558-baa8-b9c927ef9262 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:16.842007 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-4912f02e-34bf-4558-baa8-b9c927ef9262 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:16.853597 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-4912f02e-34bf-4558-baa8-b9c927ef9262 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1688 microversion: 2.1 time: 0.297169 Sep 01 14:12:16.854760 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 410/802] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:16 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1688 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:12:17.026958 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-7f1e7ca9-d75b-4cfa-8c45-4a8260eefdd5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:17.027625 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-7f1e7ca9-d75b-4cfa-8c45-4a8260eefdd5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:17.036236 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7f1e7ca9-d75b-4cfa-8c45-4a8260eefdd5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:17.036872 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7f1e7ca9-d75b-4cfa-8c45-4a8260eefdd5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:17.037414 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7f1e7ca9-d75b-4cfa-8c45-4a8260eefdd5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:17.038261 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7f1e7ca9-d75b-4cfa-8c45-4a8260eefdd5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:17.038802 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7f1e7ca9-d75b-4cfa-8c45-4a8260eefdd5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:17.039237 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7f1e7ca9-d75b-4cfa-8c45-4a8260eefdd5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:17.252674 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-7f1e7ca9-d75b-4cfa-8c45-4a8260eefdd5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:17.262155 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-7f1e7ca9-d75b-4cfa-8c45-4a8260eefdd5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:17.264073 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-7f1e7ca9-d75b-4cfa-8c45-4a8260eefdd5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:17.267204 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-7f1e7ca9-d75b-4cfa-8c45-4a8260eefdd5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1722 microversion: 2.20 time: 0.243723 Sep 01 14:12:17.267690 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 393/803] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:12:17 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1722 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:12:17.486716 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [req-f4b728bc-8ce3-43a5-928c-fe0cf5ac6c78 req-4c920c73-9a9f-43d7-98dd-7bc447b9b54e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1988647a-695e-49b8-a5d3-dd6c93c10ae5", "name": "network-vif-deleted", "tag": "f27eab44-1c4b-4c5c-95ab-4dbdc5728861"}]} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:12:17.513741 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-f4b728bc-8ce3-43a5-928c-fe0cf5ac6c78 req-4c920c73-9a9f-43d7-98dd-7bc447b9b54e service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:17.515661 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-f4b728bc-8ce3-43a5-928c-fe0cf5ac6c78 req-4c920c73-9a9f-43d7-98dd-7bc447b9b54e service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:17.526607 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-f4b728bc-8ce3-43a5-928c-fe0cf5ac6c78 req-4c920c73-9a9f-43d7-98dd-7bc447b9b54e service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:17.543722 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.compute.server_external_events [req-f4b728bc-8ce3-43a5-928c-fe0cf5ac6c78 req-4c920c73-9a9f-43d7-98dd-7bc447b9b54e service nova] Creating event network-vif-deleted:f27eab44-1c4b-4c5c-95ab-4dbdc5728861 for instance 1988647a-695e-49b8-a5d3-dd6c93c10ae5 on hv-cinder-85221 Sep 01 14:12:17.559713 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [req-f4b728bc-8ce3-43a5-928c-fe0cf5ac6c78 req-4c920c73-9a9f-43d7-98dd-7bc447b9b54e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077967 Sep 01 14:12:17.561042 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 411/804] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:12:17.896464 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-9f73ddac-aaec-4e1d-aace-4a57859e06ee tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:17.897608 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-9f73ddac-aaec-4e1d-aace-4a57859e06ee tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:17.942387 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9f73ddac-aaec-4e1d-aace-4a57859e06ee tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:17.943059 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9f73ddac-aaec-4e1d-aace-4a57859e06ee tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:17.943725 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9f73ddac-aaec-4e1d-aace-4a57859e06ee tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:17.944994 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9f73ddac-aaec-4e1d-aace-4a57859e06ee tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:17.945813 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9f73ddac-aaec-4e1d-aace-4a57859e06ee tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:17.946608 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9f73ddac-aaec-4e1d-aace-4a57859e06ee tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:18.013279 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9f73ddac-aaec-4e1d-aace-4a57859e06ee tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:18.014172 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9f73ddac-aaec-4e1d-aace-4a57859e06ee tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:18.016900 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9f73ddac-aaec-4e1d-aace-4a57859e06ee tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:18.017735 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.objects.instance [None req-9f73ddac-aaec-4e1d-aace-4a57859e06ee tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lazy-loading 'fault' on Instance uuid 1988647a-695e-49b8-a5d3-dd6c93c10ae5 {{(pid=121339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:12:18.099165 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-9f73ddac-aaec-4e1d-aace-4a57859e06ee tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:18.116812 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-9f73ddac-aaec-4e1d-aace-4a57859e06ee tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 200 len: 1335 microversion: 2.1 time: 0.228354 Sep 01 14:12:18.118347 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 394/805] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:17 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 1335 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:12:18.300028 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-d41d25e3-f974-4f59-9a34-a2b665bae6dd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:18.303926 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-d41d25e3-f974-4f59-9a34-a2b665bae6dd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:18.315263 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d41d25e3-f974-4f59-9a34-a2b665bae6dd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:18.316557 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d41d25e3-f974-4f59-9a34-a2b665bae6dd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:18.317627 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d41d25e3-f974-4f59-9a34-a2b665bae6dd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:18.318866 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d41d25e3-f974-4f59-9a34-a2b665bae6dd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:18.319602 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d41d25e3-f974-4f59-9a34-a2b665bae6dd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:18.327059 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d41d25e3-f974-4f59-9a34-a2b665bae6dd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:18.534855 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-d41d25e3-f974-4f59-9a34-a2b665bae6dd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:18.551749 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-d41d25e3-f974-4f59-9a34-a2b665bae6dd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:18.554501 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-d41d25e3-f974-4f59-9a34-a2b665bae6dd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:18.557243 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-d41d25e3-f974-4f59-9a34-a2b665bae6dd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1722 microversion: 2.20 time: 0.269209 Sep 01 14:12:18.558273 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 412/806] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:12:18 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1722 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:12:19.140933 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-a87d7533-c114-4e0d-bcad-ae6233fb44e8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:19.142466 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-a87d7533-c114-4e0d-bcad-ae6233fb44e8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 1988647a-695e-49b8-a5d3-dd6c93c10ae5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:19.150545 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a87d7533-c114-4e0d-bcad-ae6233fb44e8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:19.151340 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a87d7533-c114-4e0d-bcad-ae6233fb44e8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:19.151933 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a87d7533-c114-4e0d-bcad-ae6233fb44e8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:19.152818 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a87d7533-c114-4e0d-bcad-ae6233fb44e8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:19.153605 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a87d7533-c114-4e0d-bcad-ae6233fb44e8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:19.154667 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a87d7533-c114-4e0d-bcad-ae6233fb44e8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:19.173623 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.wsgi [None req-a87d7533-c114-4e0d-bcad-ae6233fb44e8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] HTTP exception thrown: Instance 1988647a-695e-49b8-a5d3-dd6c93c10ae5 could not be found. Sep 01 14:12:19.175619 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-a87d7533-c114-4e0d-bcad-ae6233fb44e8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Request method failure captured: Sep 01 14:12:19.175619 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: request: GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 HTTP/1.1 Sep 01 14:12:19.175619 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept: application/json Sep 01 14:12:19.175619 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept-Encoding: identity Sep 01 14:12:19.175619 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Connection: close Sep 01 14:12:19.175619 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Length: 0 Sep 01 14:12:19.175619 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Type: application/json Sep 01 14:12:19.175619 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Host: 10.222.0.25 Sep 01 14:12:19.175619 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Openstack-System-Scope: None Sep 01 14:12:19.175619 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: User-Agent: python-urllib3/1.26.12 Sep 01 14:12:19.175619 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Auth-Token: gAAAAABjELxNSn4EzJ0vI_pvxfL9hGqrffkkfs5u7M-T-ZaLF_wq7SVdY_htuaEWbVmy9Lvl0CF1D_LFwelOxAi92tddj_IJnalwYlx7xPOW4n4bgS9gHt9DKo6_AsO5Qtp2tceRb-kv99jz0XhNuJDrlowBE-mVHlpHgp4Gba56rctae9kot8o Sep 01 14:12:19.175619 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Id: None Sep 01 14:12:19.175619 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Name: None Sep 01 14:12:19.175619 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Identity-Status: Confirmed Sep 01 14:12:19.175619 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Is-Admin-Project: True Sep 01 14:12:19.175619 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Id: default Sep 01 14:12:19.175619 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Name: Default Sep 01 14:12:19.175619 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Id: 36049d2090b84443a3bf3bf00558379e Sep 01 14:12:19.175619 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-697169282 Sep 01 14:12:19.175619 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Role: member,reader Sep 01 14:12:19.175619 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Roles: member,reader Sep 01 14:12:19.179204 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/36049d2090b84443a3bf3bf00558379e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/36049d2090b84443a3bf3bf00558379e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/36049d2090b84443a3bf3bf00558379e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_36049d2090b84443a3bf3bf00558379e"}]}] Sep 01 14:12:19.179204 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant: tempest-ServerRescueNegativeTestJSON-697169282 Sep 01 14:12:19.179204 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Id: 36049d2090b84443a3bf3bf00558379e Sep 01 14:12:19.179204 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-697169282 Sep 01 14:12:19.179204 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User: tempest-ServerRescueNegativeTestJSON-697169282-project Sep 01 14:12:19.179204 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Id: default Sep 01 14:12:19.179204 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Name: Default Sep 01 14:12:19.179204 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Id: 7562a0429fdf42948174b517b211884f Sep 01 14:12:19.179204 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Name: tempest-ServerRescueNegativeTestJSON-697169282-project Sep 01 14:12:19.179204 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: method: > Sep 01 14:12:19.179204 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: exception: Instance 1988647a-695e-49b8-a5d3-dd6c93c10ae5 could not be found. Sep 01 14:12:19.179204 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: action_args: {'id': '1988647a-695e-49b8-a5d3-dd6c93c10ae5'} Sep 01 14:12:19.180999 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:12:19.180999 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:12:19.180999 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:12:19.180999 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:12:19.180999 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:12:19.180999 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:12:19.180999 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:12:19.180999 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:12:19.180999 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:12:19.180999 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:12:19.180999 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1988647a-695e-49b8-a5d3-dd6c93c10ae5 could not be found. Sep 01 14:12:19.180999 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:12:19.180999 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:12:19.180999 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:12:19.180999 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:12:19.180999 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:12:19.180999 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:12:19.180999 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:12:19.180999 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:12:19.180999 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:12:19.183967 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:12:19.183967 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:12:19.183967 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:12:19.183967 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:12:19.183967 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:12:19.183967 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:12:19.183967 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:12:19.183967 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1988647a-695e-49b8-a5d3-dd6c93c10ae5 could not be found. Sep 01 14:12:19.183967 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:12:19.183967 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:12:19.183967 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:12:19.183967 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:12:19.183967 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:12:19.183967 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:12:19.183967 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:12:19.183967 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:12:19.183967 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1988647a-695e-49b8-a5d3-dd6c93c10ae5 could not be found. Sep 01 14:12:19.183967 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:12:19.188219 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-a87d7533-c114-4e0d-bcad-ae6233fb44e8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Returning 404 to user: Instance 1988647a-695e-49b8-a5d3-dd6c93c10ae5 could not be found. {{(pid=121339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:12:19.188219 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-a87d7533-c114-4e0d-bcad-ae6233fb44e8 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5" status: 404 len: 111 microversion: 2.1 time: 0.042830 Sep 01 14:12:19.188219 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 395/807] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:19 2022] GET /compute/v2.1/servers/1988647a-695e-49b8-a5d3-dd6c93c10ae5 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:12:19.191478 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-11664246-c8eb-464e-a020-8fc91277e0a6 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '.version_select at 0x7f9867a4f550>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:19.320598 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-11664246-c8eb-464e-a020-8fc91277e0a6 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1064279577" status: 202 len: 0 microversion: 2.1 time: 0.136376 Sep 01 14:12:19.321757 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 413/808] 10.222.0.25 () {58 vars in 1221 bytes} [Thu Sep 1 14:12:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1064279577 => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:12:19.597946 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-cc05aade-820e-4535-aafa-39a5696e62a9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:19.598532 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-cc05aade-820e-4535-aafa-39a5696e62a9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:19.604982 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-cc05aade-820e-4535-aafa-39a5696e62a9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:19.605468 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-cc05aade-820e-4535-aafa-39a5696e62a9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:19.605927 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-cc05aade-820e-4535-aafa-39a5696e62a9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:19.606622 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-cc05aade-820e-4535-aafa-39a5696e62a9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:19.607067 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-cc05aade-820e-4535-aafa-39a5696e62a9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:19.607476 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-cc05aade-820e-4535-aafa-39a5696e62a9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:19.823860 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-cc05aade-820e-4535-aafa-39a5696e62a9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:19.841606 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-cc05aade-820e-4535-aafa-39a5696e62a9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:19.845642 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-cc05aade-820e-4535-aafa-39a5696e62a9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:19.848130 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-cc05aade-820e-4535-aafa-39a5696e62a9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1722 microversion: 2.20 time: 0.253831 Sep 01 14:12:19.850225 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 396/809] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:12:19 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1722 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:12:20.881003 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-3cabdf51-17d2-48ed-89e9-2801a6860245 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:20.884840 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-3cabdf51-17d2-48ed-89e9-2801a6860245 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:20.896588 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3cabdf51-17d2-48ed-89e9-2801a6860245 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:20.897100 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3cabdf51-17d2-48ed-89e9-2801a6860245 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:20.897726 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3cabdf51-17d2-48ed-89e9-2801a6860245 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:20.899136 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3cabdf51-17d2-48ed-89e9-2801a6860245 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:20.899136 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3cabdf51-17d2-48ed-89e9-2801a6860245 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:20.899565 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3cabdf51-17d2-48ed-89e9-2801a6860245 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:21.074537 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-3cabdf51-17d2-48ed-89e9-2801a6860245 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:21.088969 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-3cabdf51-17d2-48ed-89e9-2801a6860245 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:21.091724 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-3cabdf51-17d2-48ed-89e9-2801a6860245 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:21.093784 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-3cabdf51-17d2-48ed-89e9-2801a6860245 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1722 microversion: 2.20 time: 0.223230 Sep 01 14:12:21.094655 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 414/810] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:12:20 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:12:22.128238 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-bb766e8c-401c-4a2a-95f8-f77ad242e6b1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:22.130408 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-bb766e8c-401c-4a2a-95f8-f77ad242e6b1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:22.144821 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-bb766e8c-401c-4a2a-95f8-f77ad242e6b1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:22.145705 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-bb766e8c-401c-4a2a-95f8-f77ad242e6b1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:22.146610 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-bb766e8c-401c-4a2a-95f8-f77ad242e6b1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:22.147901 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-bb766e8c-401c-4a2a-95f8-f77ad242e6b1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:22.148736 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-bb766e8c-401c-4a2a-95f8-f77ad242e6b1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:22.149623 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-bb766e8c-401c-4a2a-95f8-f77ad242e6b1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:22.396733 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-bb766e8c-401c-4a2a-95f8-f77ad242e6b1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:22.418446 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-bb766e8c-401c-4a2a-95f8-f77ad242e6b1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:22.422705 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-bb766e8c-401c-4a2a-95f8-f77ad242e6b1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:22.425967 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-bb766e8c-401c-4a2a-95f8-f77ad242e6b1 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1722 microversion: 2.20 time: 0.307489 Sep 01 14:12:22.428326 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 397/811] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:12:22 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1722 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:12:23.356443 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-adfc1033-1545-4fe3-8208-50a3d0e0711e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:23.357446 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-adfc1033-1545-4fe3-8208-50a3d0e0711e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:23.373565 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-adfc1033-1545-4fe3-8208-50a3d0e0711e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:23.376034 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-adfc1033-1545-4fe3-8208-50a3d0e0711e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:23.377237 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-adfc1033-1545-4fe3-8208-50a3d0e0711e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:23.378638 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-adfc1033-1545-4fe3-8208-50a3d0e0711e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:23.379347 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-adfc1033-1545-4fe3-8208-50a3d0e0711e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:23.380134 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-adfc1033-1545-4fe3-8208-50a3d0e0711e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:23.419632 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-adfc1033-1545-4fe3-8208-50a3d0e0711e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Going to try to terminate instance {{(pid=121340) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:12:23.471432 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-9c90e5e6-f5a1-4ae3-addd-1f5d800e7b3c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:23.472384 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-9c90e5e6-f5a1-4ae3-addd-1f5d800e7b3c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:23.479699 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9c90e5e6-f5a1-4ae3-addd-1f5d800e7b3c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:23.480222 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9c90e5e6-f5a1-4ae3-addd-1f5d800e7b3c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:23.480684 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9c90e5e6-f5a1-4ae3-addd-1f5d800e7b3c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:23.481419 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9c90e5e6-f5a1-4ae3-addd-1f5d800e7b3c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:23.482100 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9c90e5e6-f5a1-4ae3-addd-1f5d800e7b3c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:23.482587 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9c90e5e6-f5a1-4ae3-addd-1f5d800e7b3c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:23.717756 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-9c90e5e6-f5a1-4ae3-addd-1f5d800e7b3c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:23.727532 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-9c90e5e6-f5a1-4ae3-addd-1f5d800e7b3c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:23.729035 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-9c90e5e6-f5a1-4ae3-addd-1f5d800e7b3c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:23.730332 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-9c90e5e6-f5a1-4ae3-addd-1f5d800e7b3c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1722 microversion: 2.20 time: 0.264282 Sep 01 14:12:23.730902 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 398/812] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:12:23 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1722 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:12:23.833521 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-adfc1033-1545-4fe3-8208-50a3d0e0711e tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "DELETE /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 204 len: 0 microversion: 2.1 time: 0.483814 Sep 01 14:12:23.834619 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 415/813] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 14:12:23 2022] DELETE /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:12:23.847081 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-18f6d51d-785a-4397-b733-2213b441f3b5 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:23.847713 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-18f6d51d-785a-4397-b733-2213b441f3b5 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:23.854838 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-18f6d51d-785a-4397-b733-2213b441f3b5 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:23.855338 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-18f6d51d-785a-4397-b733-2213b441f3b5 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:23.855777 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-18f6d51d-785a-4397-b733-2213b441f3b5 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:23.856885 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-18f6d51d-785a-4397-b733-2213b441f3b5 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:23.857546 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-18f6d51d-785a-4397-b733-2213b441f3b5 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:23.858200 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-18f6d51d-785a-4397-b733-2213b441f3b5 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:24.130087 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-18f6d51d-785a-4397-b733-2213b441f3b5 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:24.138395 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-18f6d51d-785a-4397-b733-2213b441f3b5 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1506 microversion: 2.1 time: 0.297735 Sep 01 14:12:24.138984 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 399/814] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:23 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1506 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:12:24.755996 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-eb4ba224-b903-46f1-88e7-03c6378c4486 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:24.756815 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-eb4ba224-b903-46f1-88e7-03c6378c4486 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:24.764002 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-eb4ba224-b903-46f1-88e7-03c6378c4486 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:24.764594 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-eb4ba224-b903-46f1-88e7-03c6378c4486 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:24.765863 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-eb4ba224-b903-46f1-88e7-03c6378c4486 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:24.766981 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-eb4ba224-b903-46f1-88e7-03c6378c4486 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:24.767541 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-eb4ba224-b903-46f1-88e7-03c6378c4486 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:24.768046 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-eb4ba224-b903-46f1-88e7-03c6378c4486 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:25.000255 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-eb4ba224-b903-46f1-88e7-03c6378c4486 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:25.015750 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-eb4ba224-b903-46f1-88e7-03c6378c4486 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:25.017345 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-eb4ba224-b903-46f1-88e7-03c6378c4486 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:25.018583 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-eb4ba224-b903-46f1-88e7-03c6378c4486 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1722 microversion: 2.20 time: 0.267323 Sep 01 14:12:25.019334 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 416/815] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:12:24 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1722 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:12:25.163787 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-ac67f877-94a3-455f-8665-0ee2abb09c5d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:25.164489 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-ac67f877-94a3-455f-8665-0ee2abb09c5d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:25.172381 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ac67f877-94a3-455f-8665-0ee2abb09c5d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:25.173269 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ac67f877-94a3-455f-8665-0ee2abb09c5d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:25.174004 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ac67f877-94a3-455f-8665-0ee2abb09c5d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:25.175042 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ac67f877-94a3-455f-8665-0ee2abb09c5d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:25.176065 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ac67f877-94a3-455f-8665-0ee2abb09c5d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:25.176756 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ac67f877-94a3-455f-8665-0ee2abb09c5d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:25.206136 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:12:25.261571 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-240b70db-ea5e-4895-bb84-c99092a2d86f tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:12:25.301981 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-240b70db-ea5e-4895-bb84-c99092a2d86f tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:25.305454 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-240b70db-ea5e-4895-bb84-c99092a2d86f tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:25.312286 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-240b70db-ea5e-4895-bb84-c99092a2d86f tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:25.312849 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-240b70db-ea5e-4895-bb84-c99092a2d86f tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:25.313739 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-240b70db-ea5e-4895-bb84-c99092a2d86f tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:25.314256 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-240b70db-ea5e-4895-bb84-c99092a2d86f tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:25.325623 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-240b70db-ea5e-4895-bb84-c99092a2d86f tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:25.375343 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.objects.instance [None req-240b70db-ea5e-4895-bb84-c99092a2d86f tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lazy-loading 'flavor' on Instance uuid 3cc866f4-91c1-4384-b88a-5866ca150aea {{(pid=121340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:12:25.551088 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-ac67f877-94a3-455f-8665-0ee2abb09c5d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:25.586619 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-ac67f877-94a3-455f-8665-0ee2abb09c5d tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1506 microversion: 2.1 time: 0.425921 Sep 01 14:12:25.604729 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 400/816] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:25 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1506 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:12:25.911706 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-240b70db-ea5e-4895-bb84-c99092a2d86f tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "POST /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea/action" status: 202 len: 0 microversion: 2.1 time: 0.674601 Sep 01 14:12:25.919090 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 417/817] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Sep 1 14:12:25 2022] POST /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea/action => generated 0 bytes in 683 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:12:25.928751 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-28b34eb0-aaa7-4ea9-aa5c-46e83e1f71e8 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:25.929960 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-28b34eb0-aaa7-4ea9-aa5c-46e83e1f71e8 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:25.954276 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-28b34eb0-aaa7-4ea9-aa5c-46e83e1f71e8 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:25.955639 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-28b34eb0-aaa7-4ea9-aa5c-46e83e1f71e8 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:25.956445 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-28b34eb0-aaa7-4ea9-aa5c-46e83e1f71e8 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:25.958711 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-28b34eb0-aaa7-4ea9-aa5c-46e83e1f71e8 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:25.959676 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-28b34eb0-aaa7-4ea9-aa5c-46e83e1f71e8 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:25.960759 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-28b34eb0-aaa7-4ea9-aa5c-46e83e1f71e8 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:26.052061 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-f1de9b2b-5116-4099-8c8c-661f33f3652f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:26.053397 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-f1de9b2b-5116-4099-8c8c-661f33f3652f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:26.073266 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f1de9b2b-5116-4099-8c8c-661f33f3652f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:26.074343 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f1de9b2b-5116-4099-8c8c-661f33f3652f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:26.075536 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f1de9b2b-5116-4099-8c8c-661f33f3652f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:26.078053 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f1de9b2b-5116-4099-8c8c-661f33f3652f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:26.079287 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f1de9b2b-5116-4099-8c8c-661f33f3652f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:26.080374 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f1de9b2b-5116-4099-8c8c-661f33f3652f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:26.628206 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-28b34eb0-aaa7-4ea9-aa5c-46e83e1f71e8 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:26.648755 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-28b34eb0-aaa7-4ea9-aa5c-46e83e1f71e8 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1568 microversion: 2.1 time: 0.728686 Sep 01 14:12:26.655020 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 401/818] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:25 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1568 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:12:26.664409 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [req-66381d7d-8617-490f-b739-e603cb3e0675 req-cf9740e7-266c-4cc7-9b1b-3eb5ff8e4c7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c1dec77-467a-4bb0-802c-6d7373f0aca5", "name": "network-vif-deleted", "tag": "67860822-2188-4a43-8002-58ea70df2c86"}]} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:12:26.689646 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-66381d7d-8617-490f-b739-e603cb3e0675 req-cf9740e7-266c-4cc7-9b1b-3eb5ff8e4c7d service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:26.695144 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-66381d7d-8617-490f-b739-e603cb3e0675 req-cf9740e7-266c-4cc7-9b1b-3eb5ff8e4c7d service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:26.699756 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-66381d7d-8617-490f-b739-e603cb3e0675 req-cf9740e7-266c-4cc7-9b1b-3eb5ff8e4c7d service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:26.703246 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-f1de9b2b-5116-4099-8c8c-661f33f3652f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:26.732629 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-f1de9b2b-5116-4099-8c8c-661f33f3652f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:26.746791 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.compute.server_external_events [req-66381d7d-8617-490f-b739-e603cb3e0675 req-cf9740e7-266c-4cc7-9b1b-3eb5ff8e4c7d service nova] Creating event network-vif-deleted:67860822-2188-4a43-8002-58ea70df2c86 for instance 4c1dec77-467a-4bb0-802c-6d7373f0aca5 on hv-cinder-85221 Sep 01 14:12:26.749077 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-f1de9b2b-5116-4099-8c8c-661f33f3652f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:26.751390 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-f1de9b2b-5116-4099-8c8c-661f33f3652f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1722 microversion: 2.20 time: 0.710744 Sep 01 14:12:26.757204 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 418/819] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:12:26 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1722 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:12:26.775792 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [req-66381d7d-8617-490f-b739-e603cb3e0675 req-cf9740e7-266c-4cc7-9b1b-3eb5ff8e4c7d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115864 Sep 01 14:12:26.777752 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 402/820] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:12:26.779916 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-48c4826b-436d-4682-a839-5fc8367ff07a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:26.782139 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-48c4826b-436d-4682-a839-5fc8367ff07a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:26.801624 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-48c4826b-436d-4682-a839-5fc8367ff07a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:26.802442 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-48c4826b-436d-4682-a839-5fc8367ff07a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:26.803251 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-48c4826b-436d-4682-a839-5fc8367ff07a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:26.804550 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-48c4826b-436d-4682-a839-5fc8367ff07a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:26.805384 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-48c4826b-436d-4682-a839-5fc8367ff07a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:26.806129 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-48c4826b-436d-4682-a839-5fc8367ff07a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:26.988941 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-48c4826b-436d-4682-a839-5fc8367ff07a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:27.001515 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:12:27.038889 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-48c4826b-436d-4682-a839-5fc8367ff07a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1292 microversion: 2.1 time: 0.279227 Sep 01 14:12:27.039756 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 419/821] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:26 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1292 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:12:27.703801 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-89b9c190-a6af-43f3-9892-d00ddd9ebe2d tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:27.706907 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-89b9c190-a6af-43f3-9892-d00ddd9ebe2d tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:27.718952 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-89b9c190-a6af-43f3-9892-d00ddd9ebe2d tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:27.719717 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-89b9c190-a6af-43f3-9892-d00ddd9ebe2d tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:27.720603 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-89b9c190-a6af-43f3-9892-d00ddd9ebe2d tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:27.721361 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-89b9c190-a6af-43f3-9892-d00ddd9ebe2d tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:27.722070 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-89b9c190-a6af-43f3-9892-d00ddd9ebe2d tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:27.722796 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-89b9c190-a6af-43f3-9892-d00ddd9ebe2d tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:27.803669 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-5c74565a-0180-4236-bccb-7dfedb1fd1a4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:27.804290 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-5c74565a-0180-4236-bccb-7dfedb1fd1a4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:27.811878 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5c74565a-0180-4236-bccb-7dfedb1fd1a4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:27.812767 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5c74565a-0180-4236-bccb-7dfedb1fd1a4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:27.813251 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5c74565a-0180-4236-bccb-7dfedb1fd1a4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:27.814063 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5c74565a-0180-4236-bccb-7dfedb1fd1a4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:27.814488 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5c74565a-0180-4236-bccb-7dfedb1fd1a4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:27.814905 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5c74565a-0180-4236-bccb-7dfedb1fd1a4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:28.127532 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-89b9c190-a6af-43f3-9892-d00ddd9ebe2d tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:28.149685 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-89b9c190-a6af-43f3-9892-d00ddd9ebe2d tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1568 microversion: 2.1 time: 0.457286 Sep 01 14:12:28.152728 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 403/822] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:27 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1568 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:12:28.166275 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-e7a82f76-8ed8-46c2-bfa4-222f3073bd85 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:28.168147 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-e7a82f76-8ed8-46c2-bfa4-222f3073bd85 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:28.181546 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e7a82f76-8ed8-46c2-bfa4-222f3073bd85 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:28.186163 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e7a82f76-8ed8-46c2-bfa4-222f3073bd85 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:28.186163 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e7a82f76-8ed8-46c2-bfa4-222f3073bd85 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:28.186163 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e7a82f76-8ed8-46c2-bfa4-222f3073bd85 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:28.187082 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e7a82f76-8ed8-46c2-bfa4-222f3073bd85 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:28.188184 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e7a82f76-8ed8-46c2-bfa4-222f3073bd85 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:28.218868 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-5c74565a-0180-4236-bccb-7dfedb1fd1a4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:28.256597 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-5c74565a-0180-4236-bccb-7dfedb1fd1a4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:28.259720 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-5c74565a-0180-4236-bccb-7dfedb1fd1a4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:28.270794 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-5c74565a-0180-4236-bccb-7dfedb1fd1a4 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1743 microversion: 2.20 time: 0.470798 Sep 01 14:12:28.273742 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e7a82f76-8ed8-46c2-bfa4-222f3073bd85 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:28.274982 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e7a82f76-8ed8-46c2-bfa4-222f3073bd85 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:28.276762 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e7a82f76-8ed8-46c2-bfa4-222f3073bd85 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:28.277874 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.objects.instance [None req-e7a82f76-8ed8-46c2-bfa4-222f3073bd85 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lazy-loading 'fault' on Instance uuid 4c1dec77-467a-4bb0-802c-6d7373f0aca5 {{(pid=121339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:12:28.287552 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 420/823] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:12:27 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1743 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:12:28.344724 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-e7a82f76-8ed8-46c2-bfa4-222f3073bd85 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:28.362084 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-e7a82f76-8ed8-46c2-bfa4-222f3073bd85 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 200 len: 1311 microversion: 2.1 time: 0.206821 Sep 01 14:12:28.362870 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 404/824] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:28 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 1311 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:12:29.175373 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-0fe9c747-3cb3-430e-9244-0c6c1959196f tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:29.176233 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-0fe9c747-3cb3-430e-9244-0c6c1959196f tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:29.199958 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0fe9c747-3cb3-430e-9244-0c6c1959196f tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:29.199958 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0fe9c747-3cb3-430e-9244-0c6c1959196f tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:29.199958 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0fe9c747-3cb3-430e-9244-0c6c1959196f tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:29.200716 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0fe9c747-3cb3-430e-9244-0c6c1959196f tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:29.201801 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0fe9c747-3cb3-430e-9244-0c6c1959196f tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:29.205130 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0fe9c747-3cb3-430e-9244-0c6c1959196f tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:29.313841 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-2f559eb1-3fdd-40e9-9639-da05adabc411 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:29.315275 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-2f559eb1-3fdd-40e9-9639-da05adabc411 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:29.324143 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2f559eb1-3fdd-40e9-9639-da05adabc411 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:29.324681 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2f559eb1-3fdd-40e9-9639-da05adabc411 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:29.325127 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2f559eb1-3fdd-40e9-9639-da05adabc411 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:29.325863 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2f559eb1-3fdd-40e9-9639-da05adabc411 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:29.326357 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2f559eb1-3fdd-40e9-9639-da05adabc411 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:29.326782 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2f559eb1-3fdd-40e9-9639-da05adabc411 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:29.516343 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-0fe9c747-3cb3-430e-9244-0c6c1959196f tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:29.528333 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-0fe9c747-3cb3-430e-9244-0c6c1959196f tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1568 microversion: 2.1 time: 0.357478 Sep 01 14:12:29.528942 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 421/825] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:29 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1568 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:12:29.538314 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-3581ae9f-d919-4f84-8bf2-2a1000acdb2a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:29.539447 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-3581ae9f-d919-4f84-8bf2-2a1000acdb2a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 4c1dec77-467a-4bb0-802c-6d7373f0aca5] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:29.547433 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3581ae9f-d919-4f84-8bf2-2a1000acdb2a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:29.548265 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3581ae9f-d919-4f84-8bf2-2a1000acdb2a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:29.548987 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3581ae9f-d919-4f84-8bf2-2a1000acdb2a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:29.550131 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3581ae9f-d919-4f84-8bf2-2a1000acdb2a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:29.550843 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3581ae9f-d919-4f84-8bf2-2a1000acdb2a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:29.551508 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3581ae9f-d919-4f84-8bf2-2a1000acdb2a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:29.572774 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.wsgi [None req-3581ae9f-d919-4f84-8bf2-2a1000acdb2a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] HTTP exception thrown: Instance 4c1dec77-467a-4bb0-802c-6d7373f0aca5 could not be found. Sep 01 14:12:29.589548 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-3581ae9f-d919-4f84-8bf2-2a1000acdb2a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Request method failure captured: Sep 01 14:12:29.589548 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: request: GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 HTTP/1.1 Sep 01 14:12:29.589548 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept: application/json Sep 01 14:12:29.589548 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept-Encoding: identity Sep 01 14:12:29.589548 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Connection: close Sep 01 14:12:29.589548 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Length: 0 Sep 01 14:12:29.589548 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Type: application/json Sep 01 14:12:29.589548 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Host: 10.222.0.25 Sep 01 14:12:29.589548 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Openstack-System-Scope: None Sep 01 14:12:29.589548 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: User-Agent: python-urllib3/1.26.12 Sep 01 14:12:29.589548 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Auth-Token: gAAAAABjELxNSn4EzJ0vI_pvxfL9hGqrffkkfs5u7M-T-ZaLF_wq7SVdY_htuaEWbVmy9Lvl0CF1D_LFwelOxAi92tddj_IJnalwYlx7xPOW4n4bgS9gHt9DKo6_AsO5Qtp2tceRb-kv99jz0XhNuJDrlowBE-mVHlpHgp4Gba56rctae9kot8o Sep 01 14:12:29.589548 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Id: None Sep 01 14:12:29.589548 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Name: None Sep 01 14:12:29.589548 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Identity-Status: Confirmed Sep 01 14:12:29.589548 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Is-Admin-Project: True Sep 01 14:12:29.589548 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Id: default Sep 01 14:12:29.589548 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Name: Default Sep 01 14:12:29.589548 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Id: 36049d2090b84443a3bf3bf00558379e Sep 01 14:12:29.589548 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-697169282 Sep 01 14:12:29.589548 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Role: member,reader Sep 01 14:12:29.589548 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Roles: member,reader Sep 01 14:12:29.592337 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/36049d2090b84443a3bf3bf00558379e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/36049d2090b84443a3bf3bf00558379e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/36049d2090b84443a3bf3bf00558379e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_36049d2090b84443a3bf3bf00558379e"}]}] Sep 01 14:12:29.592337 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant: tempest-ServerRescueNegativeTestJSON-697169282 Sep 01 14:12:29.592337 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Id: 36049d2090b84443a3bf3bf00558379e Sep 01 14:12:29.592337 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-697169282 Sep 01 14:12:29.592337 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User: tempest-ServerRescueNegativeTestJSON-697169282-project Sep 01 14:12:29.592337 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Id: default Sep 01 14:12:29.592337 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Name: Default Sep 01 14:12:29.592337 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Id: 7562a0429fdf42948174b517b211884f Sep 01 14:12:29.592337 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Name: tempest-ServerRescueNegativeTestJSON-697169282-project Sep 01 14:12:29.592337 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: method: > Sep 01 14:12:29.592337 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: exception: Instance 4c1dec77-467a-4bb0-802c-6d7373f0aca5 could not be found. Sep 01 14:12:29.592337 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: action_args: {'id': '4c1dec77-467a-4bb0-802c-6d7373f0aca5'} Sep 01 14:12:29.594011 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:12:29.594011 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:12:29.594011 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:12:29.594011 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:12:29.594011 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:12:29.594011 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:12:29.594011 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:12:29.594011 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:12:29.594011 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:12:29.594011 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:12:29.594011 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c1dec77-467a-4bb0-802c-6d7373f0aca5 could not be found. Sep 01 14:12:29.594011 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:12:29.594011 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:12:29.594011 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:12:29.594011 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:12:29.594011 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:12:29.594011 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:12:29.594011 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:12:29.594011 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:12:29.594011 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:12:29.599377 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:12:29.599377 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:12:29.599377 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:12:29.599377 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:12:29.599377 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:12:29.599377 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:12:29.599377 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:12:29.599377 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c1dec77-467a-4bb0-802c-6d7373f0aca5 could not be found. Sep 01 14:12:29.599377 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:12:29.599377 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:12:29.599377 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:12:29.599377 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:12:29.599377 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:12:29.599377 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:12:29.599377 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:12:29.599377 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:12:29.599377 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c1dec77-467a-4bb0-802c-6d7373f0aca5 could not be found. Sep 01 14:12:29.599377 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:12:29.604465 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-3581ae9f-d919-4f84-8bf2-2a1000acdb2a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Returning 404 to user: Instance 4c1dec77-467a-4bb0-802c-6d7373f0aca5 could not be found. {{(pid=121340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:12:29.604465 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-3581ae9f-d919-4f84-8bf2-2a1000acdb2a tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5" status: 404 len: 111 microversion: 2.1 time: 0.060909 Sep 01 14:12:29.607091 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 422/826] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:29 2022] GET /compute/v2.1/servers/4c1dec77-467a-4bb0-802c-6d7373f0aca5 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:12:29.617866 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-411a73f2-d7d6-4875-8b8f-1859370c0c6f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:29.618856 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-411a73f2-d7d6-4875-8b8f-1859370c0c6f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 846e670d-c808-44d5-be0e-9c36671fbe91] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:29.634573 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-411a73f2-d7d6-4875-8b8f-1859370c0c6f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:29.635510 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-411a73f2-d7d6-4875-8b8f-1859370c0c6f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:29.636363 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-411a73f2-d7d6-4875-8b8f-1859370c0c6f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:29.638092 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-411a73f2-d7d6-4875-8b8f-1859370c0c6f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:29.639072 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-411a73f2-d7d6-4875-8b8f-1859370c0c6f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:29.639953 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-411a73f2-d7d6-4875-8b8f-1859370c0c6f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:29.669433 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-2f559eb1-3fdd-40e9-9639-da05adabc411 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:29.680185 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-2f559eb1-3fdd-40e9-9639-da05adabc411 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:29.683842 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-2f559eb1-3fdd-40e9-9639-da05adabc411 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:29.686271 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-2f559eb1-3fdd-40e9-9639-da05adabc411 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1743 microversion: 2.20 time: 0.377508 Sep 01 14:12:29.688586 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 405/827] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:12:29 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1743 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:12:29.691333 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-411a73f2-d7d6-4875-8b8f-1859370c0c6f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 846e670d-c808-44d5-be0e-9c36671fbe91] Going to try to terminate instance {{(pid=121340) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:12:30.305434 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-411a73f2-d7d6-4875-8b8f-1859370c0c6f tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "DELETE /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91" status: 204 len: 0 microversion: 2.1 time: 0.695983 Sep 01 14:12:30.309499 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 423/828] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 14:12:29 2022] DELETE /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91 => generated 0 bytes in 701 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:12:30.325983 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-a0eff7ab-9125-47c7-a4e2-fd29d9a802ef tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:30.327657 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-a0eff7ab-9125-47c7-a4e2-fd29d9a802ef tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 846e670d-c808-44d5-be0e-9c36671fbe91] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:30.340365 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a0eff7ab-9125-47c7-a4e2-fd29d9a802ef tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:30.341246 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a0eff7ab-9125-47c7-a4e2-fd29d9a802ef tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:30.342358 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a0eff7ab-9125-47c7-a4e2-fd29d9a802ef tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:30.343924 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a0eff7ab-9125-47c7-a4e2-fd29d9a802ef tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:30.344767 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a0eff7ab-9125-47c7-a4e2-fd29d9a802ef tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:30.345754 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a0eff7ab-9125-47c7-a4e2-fd29d9a802ef tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:30.589328 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-aa52db86-0751-4f2a-ab49-c3bb745fcd18 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:30.592350 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-aa52db86-0751-4f2a-ab49-c3bb745fcd18 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:30.599654 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-a0eff7ab-9125-47c7-a4e2-fd29d9a802ef tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:30.608774 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-aa52db86-0751-4f2a-ab49-c3bb745fcd18 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:30.610793 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-aa52db86-0751-4f2a-ab49-c3bb745fcd18 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:30.611619 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-aa52db86-0751-4f2a-ab49-c3bb745fcd18 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:30.614120 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-aa52db86-0751-4f2a-ab49-c3bb745fcd18 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:30.614622 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-aa52db86-0751-4f2a-ab49-c3bb745fcd18 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:30.615054 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-aa52db86-0751-4f2a-ab49-c3bb745fcd18 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:30.618705 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-a0eff7ab-9125-47c7-a4e2-fd29d9a802ef tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91" status: 200 len: 1522 microversion: 2.1 time: 0.302870 Sep 01 14:12:30.620168 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 406/829] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:30 2022] GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91 => generated 1522 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:12:30.704379 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [req-aec36441-e524-45d9-aa01-fbe457f56064 req-f1e8738b-5a7f-41bf-ad1f-08ae76bdd19d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1", "name": "network-vif-plugged", "status": "completed", "tag": "214b6ab8-206c-4129-a639-f69abbdaa49b"}]} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:12:30.735123 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-aec36441-e524-45d9-aa01-fbe457f56064 req-f1e8738b-5a7f-41bf-ad1f-08ae76bdd19d service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:30.735913 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-aec36441-e524-45d9-aa01-fbe457f56064 req-f1e8738b-5a7f-41bf-ad1f-08ae76bdd19d service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:30.736359 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-aec36441-e524-45d9-aa01-fbe457f56064 req-f1e8738b-5a7f-41bf-ad1f-08ae76bdd19d service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:30.784741 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.compute.server_external_events [req-aec36441-e524-45d9-aa01-fbe457f56064 req-f1e8738b-5a7f-41bf-ad1f-08ae76bdd19d service nova] Creating event network-vif-plugged:214b6ab8-206c-4129-a639-f69abbdaa49b for instance d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 on hv-cinder-85221 Sep 01 14:12:30.793239 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [req-aec36441-e524-45d9-aa01-fbe457f56064 req-f1e8738b-5a7f-41bf-ad1f-08ae76bdd19d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094842 Sep 01 14:12:30.794706 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 407/830] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:12:30.810357 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-92cc242a-faf9-4a57-b365-63d0a28ea996 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:30.812929 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-92cc242a-faf9-4a57-b365-63d0a28ea996 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:30.826937 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-92cc242a-faf9-4a57-b365-63d0a28ea996 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:30.832749 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-92cc242a-faf9-4a57-b365-63d0a28ea996 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:30.832749 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-92cc242a-faf9-4a57-b365-63d0a28ea996 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:30.832749 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-92cc242a-faf9-4a57-b365-63d0a28ea996 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:30.832749 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-92cc242a-faf9-4a57-b365-63d0a28ea996 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:30.833486 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-92cc242a-faf9-4a57-b365-63d0a28ea996 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:30.891549 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-aa52db86-0751-4f2a-ab49-c3bb745fcd18 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:30.924051 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-aa52db86-0751-4f2a-ab49-c3bb745fcd18 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1568 microversion: 2.1 time: 0.363007 Sep 01 14:12:30.925266 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 424/831] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:30 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1568 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:12:31.108595 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-92cc242a-faf9-4a57-b365-63d0a28ea996 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:31.120323 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-92cc242a-faf9-4a57-b365-63d0a28ea996 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:31.122209 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-92cc242a-faf9-4a57-b365-63d0a28ea996 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:31.124629 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-92cc242a-faf9-4a57-b365-63d0a28ea996 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1738 microversion: 2.20 time: 0.322200 Sep 01 14:12:31.124629 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 408/832] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:12:30 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1738 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:12:31.652421 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-6ba7623a-fc8f-49fe-8e92-042039d9ac5b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:31.655210 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-6ba7623a-fc8f-49fe-8e92-042039d9ac5b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 846e670d-c808-44d5-be0e-9c36671fbe91] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:31.681659 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6ba7623a-fc8f-49fe-8e92-042039d9ac5b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:31.681659 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6ba7623a-fc8f-49fe-8e92-042039d9ac5b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:31.681659 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6ba7623a-fc8f-49fe-8e92-042039d9ac5b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:31.681659 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6ba7623a-fc8f-49fe-8e92-042039d9ac5b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:31.683503 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6ba7623a-fc8f-49fe-8e92-042039d9ac5b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:31.683503 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6ba7623a-fc8f-49fe-8e92-042039d9ac5b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:31.887040 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-6ba7623a-fc8f-49fe-8e92-042039d9ac5b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:31.904500 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-6ba7623a-fc8f-49fe-8e92-042039d9ac5b tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91" status: 200 len: 1522 microversion: 2.1 time: 0.259371 Sep 01 14:12:31.906619 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 425/833] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:31 2022] GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91 => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:12:31.976063 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-eff4601a-49d5-4455-ae45-b9b4656c8523 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:31.976923 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-eff4601a-49d5-4455-ae45-b9b4656c8523 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:31.984581 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-eff4601a-49d5-4455-ae45-b9b4656c8523 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:31.985084 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-eff4601a-49d5-4455-ae45-b9b4656c8523 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:31.985528 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-eff4601a-49d5-4455-ae45-b9b4656c8523 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:31.986295 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-eff4601a-49d5-4455-ae45-b9b4656c8523 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:31.986764 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-eff4601a-49d5-4455-ae45-b9b4656c8523 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:31.987196 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-eff4601a-49d5-4455-ae45-b9b4656c8523 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:32.165090 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-41a293c9-9252-40a6-b3b6-a052a4c8ca9e tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:32.166286 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-41a293c9-9252-40a6-b3b6-a052a4c8ca9e tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:32.191336 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-41a293c9-9252-40a6-b3b6-a052a4c8ca9e tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:32.192209 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-41a293c9-9252-40a6-b3b6-a052a4c8ca9e tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:32.193005 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-41a293c9-9252-40a6-b3b6-a052a4c8ca9e tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:32.194358 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-41a293c9-9252-40a6-b3b6-a052a4c8ca9e tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:32.195665 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-eff4601a-49d5-4455-ae45-b9b4656c8523 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:32.198341 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-41a293c9-9252-40a6-b3b6-a052a4c8ca9e tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:32.204384 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-41a293c9-9252-40a6-b3b6-a052a4c8ca9e tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:32.208183 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-eff4601a-49d5-4455-ae45-b9b4656c8523 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1568 microversion: 2.1 time: 0.235399 Sep 01 14:12:32.208183 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 409/834] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:31 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1568 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:12:32.393127 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-41a293c9-9252-40a6-b3b6-a052a4c8ca9e tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:32.403404 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-41a293c9-9252-40a6-b3b6-a052a4c8ca9e tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:32.404808 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-41a293c9-9252-40a6-b3b6-a052a4c8ca9e tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:32.406231 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-41a293c9-9252-40a6-b3b6-a052a4c8ca9e tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1738 microversion: 2.20 time: 0.249111 Sep 01 14:12:32.406799 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 426/835] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:12:32 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1738 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:12:32.858932 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-49c34b5d-d04b-4853-be86-7e0c7f9e59cf tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2009233229"}} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:12:32.860457 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-49c34b5d-d04b-4853-be86-7e0c7f9e59cf tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:32.892715 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-49c34b5d-d04b-4853-be86-7e0c7f9e59cf tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:32.893444 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-49c34b5d-d04b-4853-be86-7e0c7f9e59cf tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:32.895657 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-49c34b5d-d04b-4853-be86-7e0c7f9e59cf tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:32.899096 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-49c34b5d-d04b-4853-be86-7e0c7f9e59cf tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:32.901750 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-49c34b5d-d04b-4853-be86-7e0c7f9e59cf tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:32.902746 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-49c34b5d-d04b-4853-be86-7e0c7f9e59cf tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:32.928461 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-84f14cc8-38d1-4d39-b22b-8ab265a99ac1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:32.929432 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-84f14cc8-38d1-4d39-b22b-8ab265a99ac1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 846e670d-c808-44d5-be0e-9c36671fbe91] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:32.995539 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-84f14cc8-38d1-4d39-b22b-8ab265a99ac1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:32.996989 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-84f14cc8-38d1-4d39-b22b-8ab265a99ac1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:32.997982 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-84f14cc8-38d1-4d39-b22b-8ab265a99ac1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:33.001685 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-84f14cc8-38d1-4d39-b22b-8ab265a99ac1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:33.006033 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-84f14cc8-38d1-4d39-b22b-8ab265a99ac1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:33.007501 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-84f14cc8-38d1-4d39-b22b-8ab265a99ac1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:33.809819 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-84f14cc8-38d1-4d39-b22b-8ab265a99ac1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:33.846915 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-84f14cc8-38d1-4d39-b22b-8ab265a99ac1 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91" status: 200 len: 1522 microversion: 2.1 time: 0.922336 Sep 01 14:12:33.847952 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 427/836] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:32 2022] GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91 => generated 1522 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:12:33.865510 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-66f11e59-1c41-44a9-b1bb-e3c764154240 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:33.876044 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-66f11e59-1c41-44a9-b1bb-e3c764154240 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:33.895179 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-66f11e59-1c41-44a9-b1bb-e3c764154240 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:33.896027 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-66f11e59-1c41-44a9-b1bb-e3c764154240 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:33.903806 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-66f11e59-1c41-44a9-b1bb-e3c764154240 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:33.903806 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-66f11e59-1c41-44a9-b1bb-e3c764154240 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:33.903806 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-66f11e59-1c41-44a9-b1bb-e3c764154240 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:33.904345 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-66f11e59-1c41-44a9-b1bb-e3c764154240 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:33.955422 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.network.security_group_api [None req-49c34b5d-d04b-4853-be86-7e0c7f9e59cf tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Removing security group 28137255-a9b5-42bf-804b-d3e5db5441a5 from port 9784e98b-3dcc-42d6-a82e-41f46d73700f Sep 01 14:12:34.821009 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-66f11e59-1c41-44a9-b1bb-e3c764154240 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:34.858422 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-66f11e59-1c41-44a9-b1bb-e3c764154240 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1568 microversion: 2.1 time: 0.991464 Sep 01 14:12:34.860391 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 428/837] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:33 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1568 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:12:34.894212 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-59187eab-e05c-45d8-82b0-da85908824b7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:34.896109 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-59187eab-e05c-45d8-82b0-da85908824b7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:34.925229 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-59187eab-e05c-45d8-82b0-da85908824b7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:34.926115 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-59187eab-e05c-45d8-82b0-da85908824b7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:34.926917 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-59187eab-e05c-45d8-82b0-da85908824b7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:34.928143 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-59187eab-e05c-45d8-82b0-da85908824b7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:34.929001 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-59187eab-e05c-45d8-82b0-da85908824b7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:34.942428 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-59187eab-e05c-45d8-82b0-da85908824b7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:35.714681 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-59187eab-e05c-45d8-82b0-da85908824b7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:35.729962 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-59187eab-e05c-45d8-82b0-da85908824b7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:35.735518 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-59187eab-e05c-45d8-82b0-da85908824b7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:35.738511 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-59187eab-e05c-45d8-82b0-da85908824b7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1738 microversion: 2.20 time: 0.875058 Sep 01 14:12:35.753067 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 429/838] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:12:34 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1738 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:12:35.772425 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [req-305230f2-3207-49c5-83cb-1f44c5f2423b req-8913120c-99f8-4080-8e19-6e94aab1799f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "846e670d-c808-44d5-be0e-9c36671fbe91", "name": "network-vif-deleted", "tag": "073b1d8b-8a54-4df8-a7c0-5ad23c885880"}]} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:12:35.803656 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-305230f2-3207-49c5-83cb-1f44c5f2423b req-8913120c-99f8-4080-8e19-6e94aab1799f service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:35.805686 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-305230f2-3207-49c5-83cb-1f44c5f2423b req-8913120c-99f8-4080-8e19-6e94aab1799f service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:35.808873 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-305230f2-3207-49c5-83cb-1f44c5f2423b req-8913120c-99f8-4080-8e19-6e94aab1799f service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:35.841473 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.compute.server_external_events [req-305230f2-3207-49c5-83cb-1f44c5f2423b req-8913120c-99f8-4080-8e19-6e94aab1799f service nova] Creating event network-vif-deleted:073b1d8b-8a54-4df8-a7c0-5ad23c885880 for instance 846e670d-c808-44d5-be0e-9c36671fbe91 on hv-cinder-85221 Sep 01 14:12:35.852371 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [req-305230f2-3207-49c5-83cb-1f44c5f2423b req-8913120c-99f8-4080-8e19-6e94aab1799f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093856 Sep 01 14:12:35.862188 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 430/839] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:12:35.877998 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-f7a9d60d-c2df-4b25-9386-edb8fa129c95 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:35.881422 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-f7a9d60d-c2df-4b25-9386-edb8fa129c95 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 846e670d-c808-44d5-be0e-9c36671fbe91] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:35.936531 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f7a9d60d-c2df-4b25-9386-edb8fa129c95 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:35.938153 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f7a9d60d-c2df-4b25-9386-edb8fa129c95 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:35.939622 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f7a9d60d-c2df-4b25-9386-edb8fa129c95 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:35.943894 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f7a9d60d-c2df-4b25-9386-edb8fa129c95 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:35.945162 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f7a9d60d-c2df-4b25-9386-edb8fa129c95 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:35.947424 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f7a9d60d-c2df-4b25-9386-edb8fa129c95 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:36.106190 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f7a9d60d-c2df-4b25-9386-edb8fa129c95 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:36.107736 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f7a9d60d-c2df-4b25-9386-edb8fa129c95 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:36.109456 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f7a9d60d-c2df-4b25-9386-edb8fa129c95 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:36.111035 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.objects.instance [None req-f7a9d60d-c2df-4b25-9386-edb8fa129c95 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lazy-loading 'fault' on Instance uuid 846e670d-c808-44d5-be0e-9c36671fbe91 {{(pid=121340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:12:36.140174 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-49c34b5d-d04b-4853-be86-7e0c7f9e59cf tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "POST /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a/action" status: 202 len: 0 microversion: 2.1 time: 3.289005 Sep 01 14:12:36.142891 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 410/840] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Sep 1 14:12:32 2022] POST /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a/action => generated 0 bytes in 3294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 14:12:36.288107 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-f7a9d60d-c2df-4b25-9386-edb8fa129c95 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7562a0429fdf42948174b517b211884f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36049d2090b84443a3bf3bf00558379e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:36.320777 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-f7a9d60d-c2df-4b25-9386-edb8fa129c95 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91" status: 200 len: 1312 microversion: 2.1 time: 0.453712 Sep 01 14:12:36.341984 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 431/841] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:35 2022] GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91 => generated 1312 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:12:36.361770 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-7fa6e7b1-2050-4906-9225-a195f681ebf5 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:36.362770 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-7fa6e7b1-2050-4906-9225-a195f681ebf5 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:36.380457 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7fa6e7b1-2050-4906-9225-a195f681ebf5 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:36.385001 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7fa6e7b1-2050-4906-9225-a195f681ebf5 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:36.386459 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7fa6e7b1-2050-4906-9225-a195f681ebf5 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:36.387419 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7fa6e7b1-2050-4906-9225-a195f681ebf5 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:36.396780 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7fa6e7b1-2050-4906-9225-a195f681ebf5 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:36.397541 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-7fa6e7b1-2050-4906-9225-a195f681ebf5 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:36.617877 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-e2d0c685-8958-4ad0-8372-6c563579badd tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:36.620711 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-e2d0c685-8958-4ad0-8372-6c563579badd tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:36.626978 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e2d0c685-8958-4ad0-8372-6c563579badd tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:36.627489 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e2d0c685-8958-4ad0-8372-6c563579badd tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:36.627938 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e2d0c685-8958-4ad0-8372-6c563579badd tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:36.628770 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e2d0c685-8958-4ad0-8372-6c563579badd tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:36.629215 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e2d0c685-8958-4ad0-8372-6c563579badd tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:36.631555 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e2d0c685-8958-4ad0-8372-6c563579badd tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:36.675253 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-e2d0c685-8958-4ad0-8372-6c563579badd tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce/ips" status: 200 len: 151 microversion: 2.1 time: 0.529862 Sep 01 14:12:36.676143 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 411/842] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Sep 1 14:12:36 2022] GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce/ips => generated 151 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:12:36.683838 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [req-84c3d1ab-e227-4588-8722-b94d5054a5f9 req-89534388-839e-4400-80b9-107d092b111f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d917f141-65db-49b0-87ed-0e1e0b72bb4a", "tag": "9784e98b-3dcc-42d6-a82e-41f46d73700f"}]} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:12:36.705127 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-84c3d1ab-e227-4588-8722-b94d5054a5f9 req-89534388-839e-4400-80b9-107d092b111f service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:36.705922 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-84c3d1ab-e227-4588-8722-b94d5054a5f9 req-89534388-839e-4400-80b9-107d092b111f service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:36.706604 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-84c3d1ab-e227-4588-8722-b94d5054a5f9 req-89534388-839e-4400-80b9-107d092b111f service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:36.740105 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.compute.server_external_events [req-84c3d1ab-e227-4588-8722-b94d5054a5f9 req-89534388-839e-4400-80b9-107d092b111f service nova] Creating event network-changed:9784e98b-3dcc-42d6-a82e-41f46d73700f for instance d917f141-65db-49b0-87ed-0e1e0b72bb4a on hv-cinder-85221 Sep 01 14:12:36.747128 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [req-84c3d1ab-e227-4588-8722-b94d5054a5f9 req-89534388-839e-4400-80b9-107d092b111f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069248 Sep 01 14:12:36.748020 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 412/843] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:12:36.805051 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-3fd7587b-301f-41b8-b9d6-8d23c1fbbeba tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:36.806908 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-3fd7587b-301f-41b8-b9d6-8d23c1fbbeba tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:36.820024 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3fd7587b-301f-41b8-b9d6-8d23c1fbbeba tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:36.820966 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3fd7587b-301f-41b8-b9d6-8d23c1fbbeba tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:36.823166 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3fd7587b-301f-41b8-b9d6-8d23c1fbbeba tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:36.825768 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3fd7587b-301f-41b8-b9d6-8d23c1fbbeba tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:36.826557 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3fd7587b-301f-41b8-b9d6-8d23c1fbbeba tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:36.831767 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3fd7587b-301f-41b8-b9d6-8d23c1fbbeba tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:37.833016 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-3fd7587b-301f-41b8-b9d6-8d23c1fbbeba tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:37.860158 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-3fd7587b-301f-41b8-b9d6-8d23c1fbbeba tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:37.867152 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-3fd7587b-301f-41b8-b9d6-8d23c1fbbeba tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:37.869348 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-3fd7587b-301f-41b8-b9d6-8d23c1fbbeba tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1738 microversion: 2.20 time: 1.069277 Sep 01 14:12:37.909736 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 413/844] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:12:36 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1738 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:12:37.928188 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-e3644e14-6c15-4d99-974a-205a32465402 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:37.941095 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-e3644e14-6c15-4d99-974a-205a32465402 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] [instance: 846e670d-c808-44d5-be0e-9c36671fbe91] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:37.964058 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e3644e14-6c15-4d99-974a-205a32465402 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:37.965210 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e3644e14-6c15-4d99-974a-205a32465402 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:37.966206 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e3644e14-6c15-4d99-974a-205a32465402 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:37.967831 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e3644e14-6c15-4d99-974a-205a32465402 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:37.972593 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e3644e14-6c15-4d99-974a-205a32465402 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:37.974741 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e3644e14-6c15-4d99-974a-205a32465402 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:38.062811 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.wsgi [None req-e3644e14-6c15-4d99-974a-205a32465402 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] HTTP exception thrown: Instance 846e670d-c808-44d5-be0e-9c36671fbe91 could not be found. Sep 01 14:12:38.068992 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-e3644e14-6c15-4d99-974a-205a32465402 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Request method failure captured: Sep 01 14:12:38.068992 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: request: GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91 HTTP/1.1 Sep 01 14:12:38.068992 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept: application/json Sep 01 14:12:38.068992 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept-Encoding: identity Sep 01 14:12:38.068992 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Connection: close Sep 01 14:12:38.068992 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Length: 0 Sep 01 14:12:38.068992 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Type: application/json Sep 01 14:12:38.068992 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Host: 10.222.0.25 Sep 01 14:12:38.068992 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Openstack-System-Scope: None Sep 01 14:12:38.068992 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: User-Agent: python-urllib3/1.26.12 Sep 01 14:12:38.068992 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Auth-Token: gAAAAABjELxNSn4EzJ0vI_pvxfL9hGqrffkkfs5u7M-T-ZaLF_wq7SVdY_htuaEWbVmy9Lvl0CF1D_LFwelOxAi92tddj_IJnalwYlx7xPOW4n4bgS9gHt9DKo6_AsO5Qtp2tceRb-kv99jz0XhNuJDrlowBE-mVHlpHgp4Gba56rctae9kot8o Sep 01 14:12:38.068992 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Id: None Sep 01 14:12:38.068992 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Name: None Sep 01 14:12:38.068992 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Identity-Status: Confirmed Sep 01 14:12:38.068992 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Is-Admin-Project: True Sep 01 14:12:38.068992 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Id: default Sep 01 14:12:38.068992 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Name: Default Sep 01 14:12:38.068992 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Id: 36049d2090b84443a3bf3bf00558379e Sep 01 14:12:38.068992 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-697169282 Sep 01 14:12:38.068992 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Role: member,reader Sep 01 14:12:38.068992 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Roles: member,reader Sep 01 14:12:38.072388 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/36049d2090b84443a3bf3bf00558379e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/36049d2090b84443a3bf3bf00558379e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/36049d2090b84443a3bf3bf00558379e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_36049d2090b84443a3bf3bf00558379e"}]}] Sep 01 14:12:38.072388 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant: tempest-ServerRescueNegativeTestJSON-697169282 Sep 01 14:12:38.072388 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Id: 36049d2090b84443a3bf3bf00558379e Sep 01 14:12:38.072388 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-697169282 Sep 01 14:12:38.072388 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User: tempest-ServerRescueNegativeTestJSON-697169282-project Sep 01 14:12:38.072388 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Id: default Sep 01 14:12:38.072388 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Name: Default Sep 01 14:12:38.072388 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Id: 7562a0429fdf42948174b517b211884f Sep 01 14:12:38.072388 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Name: tempest-ServerRescueNegativeTestJSON-697169282-project Sep 01 14:12:38.072388 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: method: > Sep 01 14:12:38.072388 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: exception: Instance 846e670d-c808-44d5-be0e-9c36671fbe91 could not be found. Sep 01 14:12:38.072388 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: action_args: {'id': '846e670d-c808-44d5-be0e-9c36671fbe91'} Sep 01 14:12:38.073771 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:12:38.073771 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:12:38.073771 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:12:38.073771 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:12:38.073771 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:12:38.073771 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:12:38.073771 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:12:38.073771 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:12:38.073771 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:12:38.073771 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:12:38.073771 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 846e670d-c808-44d5-be0e-9c36671fbe91 could not be found. Sep 01 14:12:38.073771 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:12:38.073771 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:12:38.073771 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:12:38.073771 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:12:38.073771 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:12:38.073771 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:12:38.073771 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:12:38.073771 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:12:38.073771 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:12:38.079358 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:12:38.079358 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:12:38.079358 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:12:38.079358 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:12:38.079358 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:12:38.079358 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:12:38.079358 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:12:38.079358 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 846e670d-c808-44d5-be0e-9c36671fbe91 could not be found. Sep 01 14:12:38.079358 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:12:38.079358 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:12:38.079358 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:12:38.079358 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:12:38.079358 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:12:38.079358 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:12:38.079358 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:12:38.079358 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:12:38.079358 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 846e670d-c808-44d5-be0e-9c36671fbe91 could not be found. Sep 01 14:12:38.079358 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:12:38.085444 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-e3644e14-6c15-4d99-974a-205a32465402 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] Returning 404 to user: Instance 846e670d-c808-44d5-be0e-9c36671fbe91 could not be found. {{(pid=121339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:12:38.095745 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-e3644e14-6c15-4d99-974a-205a32465402 tempest-ServerRescueNegativeTestJSON-697169282 tempest-ServerRescueNegativeTestJSON-697169282-project] 10.222.0.25 "GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91" status: 404 len: 111 microversion: 2.1 time: 0.183043 Sep 01 14:12:38.097567 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 414/845] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:37 2022] GET /compute/v2.1/servers/846e670d-c808-44d5-be0e-9c36671fbe91 => generated 111 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:12:38.607564 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-7fa6e7b1-2050-4906-9225-a195f681ebf5 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:38.629145 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-7fa6e7b1-2050-4906-9225-a195f681ebf5 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1568 microversion: 2.1 time: 2.280559 Sep 01 14:12:38.645740 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 432/846] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:36 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1568 bytes in 2299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:12:38.932557 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-db3a4f34-5894-4aa1-aca4-eaccf417b489 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:38.932557 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-db3a4f34-5894-4aa1-aca4-eaccf417b489 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:38.932557 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:12:38.957592 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-db3a4f34-5894-4aa1-aca4-eaccf417b489 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:38.958532 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-db3a4f34-5894-4aa1-aca4-eaccf417b489 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:38.959980 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-db3a4f34-5894-4aa1-aca4-eaccf417b489 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:38.961212 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-db3a4f34-5894-4aa1-aca4-eaccf417b489 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:38.961989 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-db3a4f34-5894-4aa1-aca4-eaccf417b489 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:38.964207 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-db3a4f34-5894-4aa1-aca4-eaccf417b489 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:39.653585 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-1fd2fd7b-caf5-4bef-b28b-357ea348d5c9 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:39.665295 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-1fd2fd7b-caf5-4bef-b28b-357ea348d5c9 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:39.692820 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1fd2fd7b-caf5-4bef-b28b-357ea348d5c9 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:39.693453 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1fd2fd7b-caf5-4bef-b28b-357ea348d5c9 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:39.694314 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1fd2fd7b-caf5-4bef-b28b-357ea348d5c9 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:39.695198 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1fd2fd7b-caf5-4bef-b28b-357ea348d5c9 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:39.698515 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1fd2fd7b-caf5-4bef-b28b-357ea348d5c9 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:39.699092 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1fd2fd7b-caf5-4bef-b28b-357ea348d5c9 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:40.070702 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.objects.instance [None req-1fd2fd7b-caf5-4bef-b28b-357ea348d5c9 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lazy-loading 'services' on Instance uuid d917f141-65db-49b0-87ed-0e1e0b72bb4a {{(pid=121340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:12:40.292041 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-db3a4f34-5894-4aa1-aca4-eaccf417b489 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:40.314208 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-db3a4f34-5894-4aa1-aca4-eaccf417b489 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:40.321498 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-db3a4f34-5894-4aa1-aca4-eaccf417b489 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:40.338357 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-db3a4f34-5894-4aa1-aca4-eaccf417b489 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1738 microversion: 2.20 time: 1.403961 Sep 01 14:12:40.349263 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 415/847] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:12:38 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1738 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:12:40.361156 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [req-a8ac2429-29c6-42be-8a3d-bf4f173f3667 req-816189cb-8ef3-4cc2-b930-4ce567d36b93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d917f141-65db-49b0-87ed-0e1e0b72bb4a", "tag": "9784e98b-3dcc-42d6-a82e-41f46d73700f"}]} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:12:40.390927 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-a8ac2429-29c6-42be-8a3d-bf4f173f3667 req-816189cb-8ef3-4cc2-b930-4ce567d36b93 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:40.392341 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-a8ac2429-29c6-42be-8a3d-bf4f173f3667 req-816189cb-8ef3-4cc2-b930-4ce567d36b93 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:40.393471 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-a8ac2429-29c6-42be-8a3d-bf4f173f3667 req-816189cb-8ef3-4cc2-b930-4ce567d36b93 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:40.436708 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.compute.server_external_events [req-a8ac2429-29c6-42be-8a3d-bf4f173f3667 req-816189cb-8ef3-4cc2-b930-4ce567d36b93 service nova] Creating event network-changed:9784e98b-3dcc-42d6-a82e-41f46d73700f for instance d917f141-65db-49b0-87ed-0e1e0b72bb4a on hv-cinder-85221 Sep 01 14:12:40.467197 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [req-a8ac2429-29c6-42be-8a3d-bf4f173f3667 req-816189cb-8ef3-4cc2-b930-4ce567d36b93 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112128 Sep 01 14:12:40.472160 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 416/848] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:12:40.503075 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-67593106-29b7-49f4-aaad-62ffcca93214 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:40.507178 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-67593106-29b7-49f4-aaad-62ffcca93214 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:40.537501 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-1fd2fd7b-caf5-4bef-b28b-357ea348d5c9 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a/os-volume_attachments/2dfc3261-54cf-4572-94ae-2542264170a8" status: 202 len: 0 microversion: 2.1 time: 0.895322 Sep 01 14:12:40.538420 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 433/849] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Sep 1 14:12:39 2022] DELETE /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a/os-volume_attachments/2dfc3261-54cf-4572-94ae-2542264170a8 => generated 0 bytes in 897 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 14:12:40.562241 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-67593106-29b7-49f4-aaad-62ffcca93214 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:40.562905 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-67593106-29b7-49f4-aaad-62ffcca93214 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:40.563366 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-67593106-29b7-49f4-aaad-62ffcca93214 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:40.569770 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-67593106-29b7-49f4-aaad-62ffcca93214 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:40.576683 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-67593106-29b7-49f4-aaad-62ffcca93214 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:40.583857 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-ea2a49e1-fd36-4368-9b43-e362b0967725 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8d04e4a-1847-4667-8d29-09f787a7251e"}} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:12:40.587571 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-67593106-29b7-49f4-aaad-62ffcca93214 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:40.600007 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-ea2a49e1-fd36-4368-9b43-e362b0967725 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:40.646771 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ea2a49e1-fd36-4368-9b43-e362b0967725 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:40.648367 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ea2a49e1-fd36-4368-9b43-e362b0967725 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:40.651400 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ea2a49e1-fd36-4368-9b43-e362b0967725 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:40.659913 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ea2a49e1-fd36-4368-9b43-e362b0967725 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:40.661025 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ea2a49e1-fd36-4368-9b43-e362b0967725 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:40.661492 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ea2a49e1-fd36-4368-9b43-e362b0967725 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:41.535312 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:12:42.188366 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-67593106-29b7-49f4-aaad-62ffcca93214 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:42.216462 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-67593106-29b7-49f4-aaad-62ffcca93214 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1568 microversion: 2.1 time: 1.737717 Sep 01 14:12:42.220490 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 417/850] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:40 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1568 bytes in 1747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:12:42.241764 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-46054875-2c7c-4747-9ce3-a0b8ab0802b6 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:42.246715 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-46054875-2c7c-4747-9ce3-a0b8ab0802b6 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:42.266957 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-46054875-2c7c-4747-9ce3-a0b8ab0802b6 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:42.269291 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-46054875-2c7c-4747-9ce3-a0b8ab0802b6 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:42.270555 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-46054875-2c7c-4747-9ce3-a0b8ab0802b6 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:42.272374 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-46054875-2c7c-4747-9ce3-a0b8ab0802b6 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:42.287099 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-46054875-2c7c-4747-9ce3-a0b8ab0802b6 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:42.287099 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-46054875-2c7c-4747-9ce3-a0b8ab0802b6 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:42.392158 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-46054875-2c7c-4747-9ce3-a0b8ab0802b6 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.163670 Sep 01 14:12:42.393417 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 418/851] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 14:12:42 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:12:42.398920 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-718dc1ed-bed8-4c24-b79d-03cee06165e5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:42.399821 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-718dc1ed-bed8-4c24-b79d-03cee06165e5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:42.429742 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-718dc1ed-bed8-4c24-b79d-03cee06165e5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:42.429742 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-718dc1ed-bed8-4c24-b79d-03cee06165e5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:42.429742 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-718dc1ed-bed8-4c24-b79d-03cee06165e5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:42.429742 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-718dc1ed-bed8-4c24-b79d-03cee06165e5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:42.430418 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-718dc1ed-bed8-4c24-b79d-03cee06165e5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:42.430418 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-718dc1ed-bed8-4c24-b79d-03cee06165e5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:43.078022 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-ea2a49e1-fd36-4368-9b43-e362b0967725 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "POST /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.535970 Sep 01 14:12:43.085350 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 434/852] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Sep 1 14:12:40 2022] POST /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce/os-volume_attachments => generated 194 bytes in 2546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:12:43.094785 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [req-325d853c-0585-4eed-b0a8-e721f4265c05 req-de3eac4c-1cf8-4086-a6b8-90a40e1dc254 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cc866f4-91c1-4384-b88a-5866ca150aea", "name": "network-vif-unplugged", "status": "completed", "tag": "9b44c940-faa5-4df3-83f2-2d676ad70287"}]} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:12:43.116952 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-325d853c-0585-4eed-b0a8-e721f4265c05 req-de3eac4c-1cf8-4086-a6b8-90a40e1dc254 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:43.116952 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-325d853c-0585-4eed-b0a8-e721f4265c05 req-de3eac4c-1cf8-4086-a6b8-90a40e1dc254 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:43.116952 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-325d853c-0585-4eed-b0a8-e721f4265c05 req-de3eac4c-1cf8-4086-a6b8-90a40e1dc254 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:43.131580 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.compute.server_external_events [req-325d853c-0585-4eed-b0a8-e721f4265c05 req-de3eac4c-1cf8-4086-a6b8-90a40e1dc254 service nova] Creating event network-vif-unplugged:9b44c940-faa5-4df3-83f2-2d676ad70287 for instance 3cc866f4-91c1-4384-b88a-5866ca150aea on hv-cinder-85221 Sep 01 14:12:43.154317 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [req-325d853c-0585-4eed-b0a8-e721f4265c05 req-de3eac4c-1cf8-4086-a6b8-90a40e1dc254 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066039 Sep 01 14:12:43.162198 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 435/853] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:12:43.249583 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-af4f04d2-91a7-40c7-abee-acd07988922b tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:43.249583 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-af4f04d2-91a7-40c7-abee-acd07988922b tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:43.266351 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-af4f04d2-91a7-40c7-abee-acd07988922b tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:43.284028 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-af4f04d2-91a7-40c7-abee-acd07988922b tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:43.285095 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-af4f04d2-91a7-40c7-abee-acd07988922b tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:43.285936 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-718dc1ed-bed8-4c24-b79d-03cee06165e5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:43.289708 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-af4f04d2-91a7-40c7-abee-acd07988922b tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:43.296228 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-af4f04d2-91a7-40c7-abee-acd07988922b tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:43.297294 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-af4f04d2-91a7-40c7-abee-acd07988922b tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:43.357207 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-718dc1ed-bed8-4c24-b79d-03cee06165e5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:43.365581 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-718dc1ed-bed8-4c24-b79d-03cee06165e5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:43.367882 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-718dc1ed-bed8-4c24-b79d-03cee06165e5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1738 microversion: 2.20 time: 0.972793 Sep 01 14:12:43.370628 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 419/854] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:12:42 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1738 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:12:43.414340 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-a4063370-29e2-4719-8d24-47bdcadeba37 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:43.417241 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-a4063370-29e2-4719-8d24-47bdcadeba37 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:43.428495 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a4063370-29e2-4719-8d24-47bdcadeba37 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:43.429409 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a4063370-29e2-4719-8d24-47bdcadeba37 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:43.431121 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a4063370-29e2-4719-8d24-47bdcadeba37 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:43.433584 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a4063370-29e2-4719-8d24-47bdcadeba37 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:43.435900 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a4063370-29e2-4719-8d24-47bdcadeba37 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:43.436930 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a4063370-29e2-4719-8d24-47bdcadeba37 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:43.524610 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell1:SELECT=100 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:12:43.533578 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-a4063370-29e2-4719-8d24-47bdcadeba37 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.127628 Sep 01 14:12:43.534396 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 420/855] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 14:12:43 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a/os-volume_attachments => generated 25 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 01 14:12:43.559733 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-b951a1c4-40bd-494d-a15e-985faa4ea73d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:43.563808 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-b951a1c4-40bd-494d-a15e-985faa4ea73d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:43.630465 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b951a1c4-40bd-494d-a15e-985faa4ea73d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:43.631751 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b951a1c4-40bd-494d-a15e-985faa4ea73d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:43.632863 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b951a1c4-40bd-494d-a15e-985faa4ea73d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:43.634488 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b951a1c4-40bd-494d-a15e-985faa4ea73d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:43.638547 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b951a1c4-40bd-494d-a15e-985faa4ea73d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:43.640821 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b951a1c4-40bd-494d-a15e-985faa4ea73d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:43.955470 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.wsgi [None req-b951a1c4-40bd-494d-a15e-985faa4ea73d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] HTTP exception thrown: Instance d917f141-65db-49b0-87ed-0e1e0b72bb4a is not attached to volume 2dfc3261-54cf-4572-94ae-2542264170a8 Sep 01 14:12:43.970037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-b951a1c4-40bd-494d-a15e-985faa4ea73d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Request method failure captured: Sep 01 14:12:43.970037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: request: DELETE /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a/os-volume_attachments/2dfc3261-54cf-4572-94ae-2542264170a8 HTTP/1.1 Sep 01 14:12:43.970037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept: application/json Sep 01 14:12:43.970037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept-Encoding: identity Sep 01 14:12:43.970037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Connection: close Sep 01 14:12:43.970037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Length: 0 Sep 01 14:12:43.970037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Type: application/json Sep 01 14:12:43.970037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Host: 10.222.0.25 Sep 01 14:12:43.970037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Openstack-System-Scope: None Sep 01 14:12:43.970037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: User-Agent: python-urllib3/1.26.12 Sep 01 14:12:43.970037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Auth-Token: gAAAAABjEL0XukfFJJ4QURlpKekkvRSVYBH242Ozn4QdoZOxut0t2esEf_G_2_SVJfv53iZ_7eXencfvFinsyIeUmgRXs6Y9V9IfNM1aI3it1LjGfAbtLdW667QQWe0Ws3NufUQAnR4o7eZh5FpG42InbL-75008FvCBmmDDdKMQqJQib0jaWUs Sep 01 14:12:43.970037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Id: None Sep 01 14:12:43.970037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Name: None Sep 01 14:12:43.970037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Identity-Status: Confirmed Sep 01 14:12:43.970037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Is-Admin-Project: True Sep 01 14:12:43.970037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Id: default Sep 01 14:12:43.970037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Name: Default Sep 01 14:12:43.970037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Id: adf6f1699a0740ee99ae03ef2423d143 Sep 01 14:12:43.970037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Name: tempest-TestMinimumBasicScenario-176715321 Sep 01 14:12:43.970037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Role: member,reader Sep 01 14:12:43.970037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Roles: member,reader Sep 01 14:12:43.977249 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/adf6f1699a0740ee99ae03ef2423d143"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/adf6f1699a0740ee99ae03ef2423d143"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/adf6f1699a0740ee99ae03ef2423d143"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_adf6f1699a0740ee99ae03ef2423d143"}]}] Sep 01 14:12:43.977249 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant: tempest-TestMinimumBasicScenario-176715321 Sep 01 14:12:43.977249 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Id: adf6f1699a0740ee99ae03ef2423d143 Sep 01 14:12:43.977249 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Name: tempest-TestMinimumBasicScenario-176715321 Sep 01 14:12:43.977249 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User: tempest-TestMinimumBasicScenario-176715321-project Sep 01 14:12:43.977249 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Id: default Sep 01 14:12:43.977249 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Name: Default Sep 01 14:12:43.977249 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Id: 77b0f8fe6dde4842bb3d03150ebe9916 Sep 01 14:12:43.977249 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Name: tempest-TestMinimumBasicScenario-176715321-project Sep 01 14:12:43.977249 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: method: > Sep 01 14:12:43.977249 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: exception: Instance d917f141-65db-49b0-87ed-0e1e0b72bb4a is not attached to volume 2dfc3261-54cf-4572-94ae-2542264170a8 Sep 01 14:12:43.980197 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: action_args: {'server_id': 'd917f141-65db-49b0-87ed-0e1e0b72bb4a', 'id': '2dfc3261-54cf-4572-94ae-2542264170a8'} Sep 01 14:12:43.980197 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:12:43.980197 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:12:43.980197 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 01 14:12:43.980197 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 01 14:12:43.980197 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 14:12:43.980197 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 14:12:43.980197 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 01 14:12:43.980197 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 01 14:12:43.980197 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 2dfc3261-54cf-4572-94ae-2542264170a8. Sep 01 14:12:43.980197 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:12:43.980197 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:12:43.980197 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:12:43.980197 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:12:43.980197 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:12:43.980197 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:12:43.980197 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:12:43.980197 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:12:43.980197 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:12:43.984878 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:12:43.984878 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 01 14:12:43.984878 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 01 14:12:43.984878 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d917f141-65db-49b0-87ed-0e1e0b72bb4a is not attached to volume 2dfc3261-54cf-4572-94ae-2542264170a8 Sep 01 14:12:43.984878 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:12:43.984878 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:12:43.984878 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:12:43.984878 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:12:43.984878 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:12:43.984878 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:12:43.984878 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:12:43.984878 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:12:43.984878 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d917f141-65db-49b0-87ed-0e1e0b72bb4a is not attached to volume 2dfc3261-54cf-4572-94ae-2542264170a8 Sep 01 14:12:43.984878 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:12:43.995220 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-af4f04d2-91a7-40c7-abee-acd07988922b tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:44.003392 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-b951a1c4-40bd-494d-a15e-985faa4ea73d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Returning 404 to user: Instance d917f141-65db-49b0-87ed-0e1e0b72bb4a is not attached to volume 2dfc3261-54cf-4572-94ae-2542264170a8 {{(pid=121339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:12:44.011984 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-b951a1c4-40bd-494d-a15e-985faa4ea73d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a/os-volume_attachments/2dfc3261-54cf-4572-94ae-2542264170a8" status: 404 len: 154 microversion: 2.1 time: 0.460045 Sep 01 14:12:44.021035 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 421/856] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Sep 1 14:12:43 2022] DELETE /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a/os-volume_attachments/2dfc3261-54cf-4572-94ae-2542264170a8 => generated 154 bytes in 475 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 14:12:44.053289 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-af4f04d2-91a7-40c7-abee-acd07988922b tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1569 microversion: 2.1 time: 0.814310 Sep 01 14:12:44.062341 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 436/857] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:43 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1569 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:12:44.110352 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-430f1929-8726-444b-b803-12c2562edafe tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:12:44.113661 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-430f1929-8726-444b-b803-12c2562edafe tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:44.131211 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-430f1929-8726-444b-b803-12c2562edafe tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:44.132677 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-430f1929-8726-444b-b803-12c2562edafe tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:44.133860 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-430f1929-8726-444b-b803-12c2562edafe tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:44.136091 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-430f1929-8726-444b-b803-12c2562edafe tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:44.137257 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-430f1929-8726-444b-b803-12c2562edafe tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:44.140355 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-430f1929-8726-444b-b803-12c2562edafe tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:44.256728 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-430f1929-8726-444b-b803-12c2562edafe tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121339) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 01 14:12:44.424619 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-543555d4-73d3-46b5-8a49-8269c283734a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:44.425752 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-543555d4-73d3-46b5-8a49-8269c283734a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:44.486291 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-543555d4-73d3-46b5-8a49-8269c283734a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:44.490587 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-543555d4-73d3-46b5-8a49-8269c283734a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:44.492963 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-543555d4-73d3-46b5-8a49-8269c283734a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:44.503442 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-543555d4-73d3-46b5-8a49-8269c283734a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:44.504450 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-543555d4-73d3-46b5-8a49-8269c283734a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:44.509701 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-543555d4-73d3-46b5-8a49-8269c283734a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:45.151774 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-430f1929-8726-444b-b803-12c2562edafe tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "POST /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea/action" status: 202 len: 0 microversion: 2.1 time: 1.050456 Sep 01 14:12:45.164679 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 422/858] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Sep 1 14:12:44 2022] POST /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea/action => generated 0 bytes in 1065 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:12:45.201920 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-8d7d26c0-c2c3-491a-bb96-b6b84b10145e tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:45.203393 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-8d7d26c0-c2c3-491a-bb96-b6b84b10145e tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:45.227609 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8d7d26c0-c2c3-491a-bb96-b6b84b10145e tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:45.229183 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8d7d26c0-c2c3-491a-bb96-b6b84b10145e tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:45.230489 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8d7d26c0-c2c3-491a-bb96-b6b84b10145e tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:45.233511 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8d7d26c0-c2c3-491a-bb96-b6b84b10145e tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:45.234805 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8d7d26c0-c2c3-491a-bb96-b6b84b10145e tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:45.236330 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8d7d26c0-c2c3-491a-bb96-b6b84b10145e tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:45.348477 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-543555d4-73d3-46b5-8a49-8269c283734a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:45.377071 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-543555d4-73d3-46b5-8a49-8269c283734a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:45.381485 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-543555d4-73d3-46b5-8a49-8269c283734a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:45.392521 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-543555d4-73d3-46b5-8a49-8269c283734a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1738 microversion: 2.20 time: 0.983492 Sep 01 14:12:45.399659 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 437/859] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:12:44 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1738 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:12:45.763049 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-12ea4714-3429-46c8-a470-fe44ee594444 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:45.763049 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-12ea4714-3429-46c8-a470-fe44ee594444 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:45.763049 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-12ea4714-3429-46c8-a470-fe44ee594444 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:45.763049 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-12ea4714-3429-46c8-a470-fe44ee594444 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:45.766887 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-12ea4714-3429-46c8-a470-fe44ee594444 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:45.766887 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-12ea4714-3429-46c8-a470-fe44ee594444 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:45.766887 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-12ea4714-3429-46c8-a470-fe44ee594444 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:45.766887 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-12ea4714-3429-46c8-a470-fe44ee594444 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:45.853417 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-12ea4714-3429-46c8-a470-fe44ee594444 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Going to try to terminate instance {{(pid=121340) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:12:46.379662 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-8d7d26c0-c2c3-491a-bb96-b6b84b10145e tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:46.393691 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-8d7d26c0-c2c3-491a-bb96-b6b84b10145e tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1517 microversion: 2.1 time: 1.216145 Sep 01 14:12:46.396170 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 423/860] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:45 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1517 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:12:46.408822 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-12ea4714-3429-46c8-a470-fe44ee594444 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 204 len: 0 microversion: 2.1 time: 0.717474 Sep 01 14:12:46.429874 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 438/861] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 14:12:45 2022] DELETE /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 0 bytes in 729 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 14:12:46.434401 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-aef1152f-7863-4417-bcad-a7b7a27f950b tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:46.434401 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-aef1152f-7863-4417-bcad-a7b7a27f950b tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:46.445782 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-aef1152f-7863-4417-bcad-a7b7a27f950b tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:46.446403 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-aef1152f-7863-4417-bcad-a7b7a27f950b tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:46.447202 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-aef1152f-7863-4417-bcad-a7b7a27f950b tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:46.448818 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-aef1152f-7863-4417-bcad-a7b7a27f950b tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:46.449643 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-aef1152f-7863-4417-bcad-a7b7a27f950b tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:46.455089 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-aef1152f-7863-4417-bcad-a7b7a27f950b tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:46.460993 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-b5e99247-c50d-4cfe-8129-1fd160a41fed tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:46.468736 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-b5e99247-c50d-4cfe-8129-1fd160a41fed tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:46.483398 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b5e99247-c50d-4cfe-8129-1fd160a41fed tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:46.485252 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b5e99247-c50d-4cfe-8129-1fd160a41fed tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:46.487458 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b5e99247-c50d-4cfe-8129-1fd160a41fed tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:46.488844 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b5e99247-c50d-4cfe-8129-1fd160a41fed tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:46.489851 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b5e99247-c50d-4cfe-8129-1fd160a41fed tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:46.490788 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b5e99247-c50d-4cfe-8129-1fd160a41fed tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:46.847236 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-aef1152f-7863-4417-bcad-a7b7a27f950b tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:46.868250 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-aef1152f-7863-4417-bcad-a7b7a27f950b tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1674 microversion: 2.1 time: 0.443777 Sep 01 14:12:46.873383 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 424/862] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:46 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1674 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:12:46.875545 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-d4cc95b5-e0d3-44cc-adf1-8c0b4fca437b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:46.877011 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-d4cc95b5-e0d3-44cc-adf1-8c0b4fca437b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 8a8b6392-8237-47f3-9a9b-7a80f18f71c3] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:46.898684 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d4cc95b5-e0d3-44cc-adf1-8c0b4fca437b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:46.899330 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d4cc95b5-e0d3-44cc-adf1-8c0b4fca437b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:46.899882 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d4cc95b5-e0d3-44cc-adf1-8c0b4fca437b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:46.900734 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d4cc95b5-e0d3-44cc-adf1-8c0b4fca437b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:46.901952 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-b5e99247-c50d-4cfe-8129-1fd160a41fed tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:46.914738 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d4cc95b5-e0d3-44cc-adf1-8c0b4fca437b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:46.915464 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d4cc95b5-e0d3-44cc-adf1-8c0b4fca437b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:46.921354 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-b5e99247-c50d-4cfe-8129-1fd160a41fed tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:46.926396 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-b5e99247-c50d-4cfe-8129-1fd160a41fed tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:46.931199 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-b5e99247-c50d-4cfe-8129-1fd160a41fed tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1738 microversion: 2.20 time: 0.490860 Sep 01 14:12:46.938527 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 439/863] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:12:46 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1738 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:12:46.976908 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-d4cc95b5-e0d3-44cc-adf1-8c0b4fca437b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3/ips" status: 200 len: 145 microversion: 2.1 time: 0.105989 Sep 01 14:12:46.977877 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 425/864] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Sep 1 14:12:46 2022] GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3/ips => generated 145 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:12:47.449164 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-6d5e5417-83b7-4a70-bddf-818c70b5380c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:47.455440 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-6d5e5417-83b7-4a70-bddf-818c70b5380c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:47.476252 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:12:47.501539 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6d5e5417-83b7-4a70-bddf-818c70b5380c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:47.504421 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6d5e5417-83b7-4a70-bddf-818c70b5380c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:47.505610 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6d5e5417-83b7-4a70-bddf-818c70b5380c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:47.511620 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6d5e5417-83b7-4a70-bddf-818c70b5380c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:47.518846 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6d5e5417-83b7-4a70-bddf-818c70b5380c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:47.520512 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6d5e5417-83b7-4a70-bddf-818c70b5380c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:47.920072 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-53ede0f8-cd65-4762-8656-6374d0a2f157 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:47.921232 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-53ede0f8-cd65-4762-8656-6374d0a2f157 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:47.935837 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-53ede0f8-cd65-4762-8656-6374d0a2f157 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:47.938263 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-53ede0f8-cd65-4762-8656-6374d0a2f157 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:47.944177 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-53ede0f8-cd65-4762-8656-6374d0a2f157 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:47.944177 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-53ede0f8-cd65-4762-8656-6374d0a2f157 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:47.944177 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-53ede0f8-cd65-4762-8656-6374d0a2f157 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:47.945133 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-53ede0f8-cd65-4762-8656-6374d0a2f157 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:48.428265 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-6d5e5417-83b7-4a70-bddf-818c70b5380c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:48.460128 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-6d5e5417-83b7-4a70-bddf-818c70b5380c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1517 microversion: 2.1 time: 1.017678 Sep 01 14:12:48.490508 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 440/865] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:47 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1517 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:12:48.509232 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-666e58a9-de0c-4296-967b-c7bbcd593398 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:48.515502 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-666e58a9-de0c-4296-967b-c7bbcd593398 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:48.536568 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-666e58a9-de0c-4296-967b-c7bbcd593398 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:48.537455 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-666e58a9-de0c-4296-967b-c7bbcd593398 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:48.538365 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-666e58a9-de0c-4296-967b-c7bbcd593398 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:48.539629 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-666e58a9-de0c-4296-967b-c7bbcd593398 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:48.540447 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-666e58a9-de0c-4296-967b-c7bbcd593398 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:48.541197 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-666e58a9-de0c-4296-967b-c7bbcd593398 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:48.890759 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-53ede0f8-cd65-4762-8656-6374d0a2f157 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:48.927059 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-53ede0f8-cd65-4762-8656-6374d0a2f157 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1674 microversion: 2.1 time: 1.012920 Sep 01 14:12:48.980938 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 426/866] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:47 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1674 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:12:49.201793 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-666e58a9-de0c-4296-967b-c7bbcd593398 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:49.243020 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-666e58a9-de0c-4296-967b-c7bbcd593398 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:49.261473 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-666e58a9-de0c-4296-967b-c7bbcd593398 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:49.264210 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-666e58a9-de0c-4296-967b-c7bbcd593398 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1738 microversion: 2.20 time: 0.770476 Sep 01 14:12:49.268870 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 441/867] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:12:48 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1738 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:12:49.504959 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-39d11a66-84bc-47ba-b2ca-1d58674de3a5 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:49.507334 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-39d11a66-84bc-47ba-b2ca-1d58674de3a5 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:49.570641 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-39d11a66-84bc-47ba-b2ca-1d58674de3a5 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:49.586923 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-39d11a66-84bc-47ba-b2ca-1d58674de3a5 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:49.587892 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-39d11a66-84bc-47ba-b2ca-1d58674de3a5 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:49.589248 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-39d11a66-84bc-47ba-b2ca-1d58674de3a5 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:49.590075 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-39d11a66-84bc-47ba-b2ca-1d58674de3a5 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:49.590822 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-39d11a66-84bc-47ba-b2ca-1d58674de3a5 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:49.718362 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-f68184c0-a603-4058-b81b-bed74b124cd1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa2d451b-0ddc-445a-ae44-c943aa83f1ba"}} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:12:49.734219 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-f68184c0-a603-4058-b81b-bed74b124cd1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 8a8b6392-8237-47f3-9a9b-7a80f18f71c3] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:49.788498 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f68184c0-a603-4058-b81b-bed74b124cd1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:49.789670 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f68184c0-a603-4058-b81b-bed74b124cd1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:49.790433 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f68184c0-a603-4058-b81b-bed74b124cd1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:49.796410 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f68184c0-a603-4058-b81b-bed74b124cd1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:49.804691 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f68184c0-a603-4058-b81b-bed74b124cd1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:49.811870 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f68184c0-a603-4058-b81b-bed74b124cd1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:50.401976 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-39d11a66-84bc-47ba-b2ca-1d58674de3a5 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:50.427765 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-39d11a66-84bc-47ba-b2ca-1d58674de3a5 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1519 microversion: 2.1 time: 0.930326 Sep 01 14:12:50.430373 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 427/868] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:49 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1519 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:12:50.437774 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-83b748f8-abaa-4e0c-b41c-8a01b5a2ec41 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:50.444510 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-83b748f8-abaa-4e0c-b41c-8a01b5a2ec41 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:50.450173 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-83b748f8-abaa-4e0c-b41c-8a01b5a2ec41 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:50.450908 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-83b748f8-abaa-4e0c-b41c-8a01b5a2ec41 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:50.451516 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-83b748f8-abaa-4e0c-b41c-8a01b5a2ec41 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:50.452719 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-83b748f8-abaa-4e0c-b41c-8a01b5a2ec41 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:50.453406 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-83b748f8-abaa-4e0c-b41c-8a01b5a2ec41 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:50.454065 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-83b748f8-abaa-4e0c-b41c-8a01b5a2ec41 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:51.053716 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-83b748f8-abaa-4e0c-b41c-8a01b5a2ec41 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:51.065836 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-83b748f8-abaa-4e0c-b41c-8a01b5a2ec41 tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1555 microversion: 2.1 time: 0.631627 Sep 01 14:12:51.067124 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 428/869] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:50 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1555 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:12:51.072550 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-26f46838-9edd-46f9-9758-7e9b14beebeb tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:51.073486 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-26f46838-9edd-46f9-9758-7e9b14beebeb tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:51.081745 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-26f46838-9edd-46f9-9758-7e9b14beebeb tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:51.082969 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-26f46838-9edd-46f9-9758-7e9b14beebeb tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:51.083761 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-26f46838-9edd-46f9-9758-7e9b14beebeb tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:51.084802 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-26f46838-9edd-46f9-9758-7e9b14beebeb tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:51.085511 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-26f46838-9edd-46f9-9758-7e9b14beebeb tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:51.086210 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-26f46838-9edd-46f9-9758-7e9b14beebeb tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:51.382671 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-26f46838-9edd-46f9-9758-7e9b14beebeb tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:51.395668 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-26f46838-9edd-46f9-9758-7e9b14beebeb tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:51.400890 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-26f46838-9edd-46f9-9758-7e9b14beebeb tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:51.405621 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-26f46838-9edd-46f9-9758-7e9b14beebeb tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1738 microversion: 2.20 time: 0.335913 Sep 01 14:12:51.409712 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 429/870] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:12:51 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1738 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:12:51.718070 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-f68184c0-a603-4058-b81b-bed74b124cd1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "POST /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.019285 Sep 01 14:12:51.721021 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 442/871] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Sep 1 14:12:49 2022] POST /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3/os-volume_attachments => generated 194 bytes in 2023 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:12:51.733851 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [req-d66320d5-8713-4363-975e-dbc169eff790 req-e49d0932-e93f-4529-8ec3-c55e8e8abdf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d917f141-65db-49b0-87ed-0e1e0b72bb4a", "name": "network-vif-deleted", "tag": "9784e98b-3dcc-42d6-a82e-41f46d73700f"}]} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:12:51.787542 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-4b72fc49-dae7-4ad3-bcc3-4bb952582712 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Action: 'create', calling method: .version_select at 0x7f986b3b18b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1695617707", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZb50cyCSFeXPdrUcGJpZu/M4L+mL449sbM/sU+gB9tdDc3Feg3u/aFril5Ca7qm9u1AcCmJo8hdPovuHdpmH+ssu6Lrt2HfekBb5+sEGE/o2dCv4eU85eRBve6iv45Xw=="}} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:12:51.810825 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-d66320d5-8713-4363-975e-dbc169eff790 req-e49d0932-e93f-4529-8ec3-c55e8e8abdf2 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:51.810825 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-d66320d5-8713-4363-975e-dbc169eff790 req-e49d0932-e93f-4529-8ec3-c55e8e8abdf2 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:51.810825 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-d66320d5-8713-4363-975e-dbc169eff790 req-e49d0932-e93f-4529-8ec3-c55e8e8abdf2 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:51.855316 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.quota [None req-4b72fc49-dae7-4ad3-bcc3-4bb952582712 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Getting quotas for project 8acdb976501045c0813d16f3d0ffd13d. Resources: {'key_pairs'} {{(pid=121339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:12:51.865409 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.quota [None req-4b72fc49-dae7-4ad3-bcc3-4bb952582712 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Getting quotas for user 93f843d15d194f0b9f44ec33c49b9b4c and project 8acdb976501045c0813d16f3d0ffd13d. Resources: {'key_pairs'} {{(pid=121339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:12:51.879111 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.compute.server_external_events [req-d66320d5-8713-4363-975e-dbc169eff790 req-e49d0932-e93f-4529-8ec3-c55e8e8abdf2 service nova] Creating event network-vif-deleted:9784e98b-3dcc-42d6-a82e-41f46d73700f for instance d917f141-65db-49b0-87ed-0e1e0b72bb4a on hv-cinder-85221 Sep 01 14:12:51.903702 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [req-d66320d5-8713-4363-975e-dbc169eff790 req-e49d0932-e93f-4529-8ec3-c55e8e8abdf2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182672 Sep 01 14:12:51.918855 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 443/872] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:12:51.938380 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-060c921d-d259-4b53-9be3-c251b47b20fa tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:51.938380 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-060c921d-d259-4b53-9be3-c251b47b20fa tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:51.991496 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-060c921d-d259-4b53-9be3-c251b47b20fa tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:51.991986 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-060c921d-d259-4b53-9be3-c251b47b20fa tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:51.992428 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-060c921d-d259-4b53-9be3-c251b47b20fa tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:51.993255 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-060c921d-d259-4b53-9be3-c251b47b20fa tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:51.995476 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-060c921d-d259-4b53-9be3-c251b47b20fa tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:51.997677 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-060c921d-d259-4b53-9be3-c251b47b20fa tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:52.055233 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-4b72fc49-dae7-4ad3-bcc3-4bb952582712 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.643957 Sep 01 14:12:52.056127 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 430/873] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Sep 1 14:12:51 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:12:52.073628 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-92357d5e-f1c4-4a13-ad3e-29c64de145a4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8d04e4a-1847-4667-8d29-09f787a7251e"}} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:12:52.087317 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-92357d5e-f1c4-4a13-ad3e-29c64de145a4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:52.119631 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-92357d5e-f1c4-4a13-ad3e-29c64de145a4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:52.121325 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-92357d5e-f1c4-4a13-ad3e-29c64de145a4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:52.121876 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-92357d5e-f1c4-4a13-ad3e-29c64de145a4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:52.122659 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-92357d5e-f1c4-4a13-ad3e-29c64de145a4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:52.132228 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-92357d5e-f1c4-4a13-ad3e-29c64de145a4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:52.133962 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-92357d5e-f1c4-4a13-ad3e-29c64de145a4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:52.432869 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.wsgi [None req-92357d5e-f1c4-4a13-ad3e-29c64de145a4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] HTTP exception thrown: Invalid volume: volume f8d04e4a-1847-4667-8d29-09f787a7251e is already attached to instances: 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce Sep 01 14:12:52.442722 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-92357d5e-f1c4-4a13-ad3e-29c64de145a4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Request method failure captured: Sep 01 14:12:52.442722 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: request: POST /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce/os-volume_attachments HTTP/1.1 Sep 01 14:12:52.442722 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept: application/json Sep 01 14:12:52.442722 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept-Encoding: identity Sep 01 14:12:52.442722 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Connection: close Sep 01 14:12:52.442722 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Length: 74 Sep 01 14:12:52.442722 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Type: application/json Sep 01 14:12:52.442722 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Host: 10.222.0.25 Sep 01 14:12:52.442722 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Openstack-System-Scope: None Sep 01 14:12:52.442722 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: User-Agent: python-urllib3/1.26.12 Sep 01 14:12:52.442722 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Auth-Token: gAAAAABjELyhZj5Hr9I4grX9g-sLmSzxOFwV6C8_UuPsJu0TTboeG4lPJ1EtlgmTO6Q18ohdm_zKgQxmrLRlDi5SpU-ZjSVzLIRa5u6LBsCTR0TutJimllLkII0Ts1UxHVT4475s7UI-5uK5aNVzYOSUMxaGRq9ZaCGPwi2wkROzwm6JUQLDfLI Sep 01 14:12:52.442722 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Id: None Sep 01 14:12:52.442722 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Name: None Sep 01 14:12:52.442722 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Identity-Status: Confirmed Sep 01 14:12:52.442722 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Is-Admin-Project: True Sep 01 14:12:52.442722 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Id: default Sep 01 14:12:52.442722 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Name: Default Sep 01 14:12:52.442722 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Id: 90a84500a899479aabfa3aeb72b4c4ae Sep 01 14:12:52.442722 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Name: tempest-AttachVolumeNegativeTest-836381067 Sep 01 14:12:52.442722 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Role: member,reader Sep 01 14:12:52.442722 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Roles: member,reader Sep 01 14:12:52.445713 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/90a84500a899479aabfa3aeb72b4c4ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/90a84500a899479aabfa3aeb72b4c4ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/90a84500a899479aabfa3aeb72b4c4ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_90a84500a899479aabfa3aeb72b4c4ae"}]}] Sep 01 14:12:52.445713 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant: tempest-AttachVolumeNegativeTest-836381067 Sep 01 14:12:52.445713 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Id: 90a84500a899479aabfa3aeb72b4c4ae Sep 01 14:12:52.445713 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-836381067 Sep 01 14:12:52.445713 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User: tempest-AttachVolumeNegativeTest-836381067-project Sep 01 14:12:52.445713 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Id: default Sep 01 14:12:52.445713 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Name: Default Sep 01 14:12:52.445713 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Id: 7ae66df61a764a42a1b1b15f54d5c34b Sep 01 14:12:52.445713 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Name: tempest-AttachVolumeNegativeTest-836381067-project Sep 01 14:12:52.445713 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Sep 01 14:12:52.445713 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: {"volumeAttachment": {"volumeId": "f8d04e4a-1847-4667-8d29-09f787a7251e"}} Sep 01 14:12:52.445713 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: method: > Sep 01 14:12:52.447637 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: exception: Invalid volume: volume f8d04e4a-1847-4667-8d29-09f787a7251e is already attached to instances: 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce Sep 01 14:12:52.447637 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: action_args: {'server_id': '7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce', 'body': {'volumeAttachment': {'volumeId': 'f8d04e4a-1847-4667-8d29-09f787a7251e'}}} Sep 01 14:12:52.447637 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:12:52.447637 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:12:52.447637 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 14:12:52.447637 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 14:12:52.447637 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 14:12:52.447637 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 14:12:52.447637 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 01 14:12:52.447637 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 14:12:52.447637 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 01 14:12:52.447637 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 01 14:12:52.447637 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 01 14:12:52.447637 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 01 14:12:52.447637 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f8d04e4a-1847-4667-8d29-09f787a7251e is already attached to instances: 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce Sep 01 14:12:52.447637 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:12:52.447637 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:12:52.447637 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:12:52.447637 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:12:52.450941 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:12:52.450941 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:12:52.450941 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:12:52.450941 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:12:52.450941 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:12:52.450941 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:12:52.450941 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 14:12:52.450941 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 14:12:52.450941 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 14:12:52.450941 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 14:12:52.450941 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 14:12:52.450941 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 14:12:52.450941 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 01 14:12:52.450941 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 01 14:12:52.450941 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f8d04e4a-1847-4667-8d29-09f787a7251e is already attached to instances: 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce Sep 01 14:12:52.450941 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:12:52.450941 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:12:52.450941 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:12:52.450941 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:12:52.450941 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:12:52.454024 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:12:52.454024 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:12:52.454024 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:12:52.454024 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f8d04e4a-1847-4667-8d29-09f787a7251e is already attached to instances: 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce Sep 01 14:12:52.454024 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:12:52.464178 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-92357d5e-f1c4-4a13-ad3e-29c64de145a4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Returning 400 to user: Invalid volume: volume f8d04e4a-1847-4667-8d29-09f787a7251e is already attached to instances: 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce {{(pid=121339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:12:52.464178 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-92357d5e-f1c4-4a13-ad3e-29c64de145a4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "POST /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.403963 Sep 01 14:12:52.474485 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 431/874] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Sep 1 14:12:52 2022] POST /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce/os-volume_attachments => generated 174 bytes in 417 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 14:12:52.512208 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-e67830f6-6fbb-4ede-97f0-3e9f122c511d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:52.513633 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-e67830f6-6fbb-4ede-97f0-3e9f122c511d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:52.538328 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e67830f6-6fbb-4ede-97f0-3e9f122c511d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:52.539231 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e67830f6-6fbb-4ede-97f0-3e9f122c511d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:52.545267 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e67830f6-6fbb-4ede-97f0-3e9f122c511d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:52.548853 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e67830f6-6fbb-4ede-97f0-3e9f122c511d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:52.553939 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e67830f6-6fbb-4ede-97f0-3e9f122c511d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:52.556044 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e67830f6-6fbb-4ede-97f0-3e9f122c511d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:52.654345 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e67830f6-6fbb-4ede-97f0-3e9f122c511d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:52.654345 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e67830f6-6fbb-4ede-97f0-3e9f122c511d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:52.654345 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e67830f6-6fbb-4ede-97f0-3e9f122c511d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:52.654345 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.objects.instance [None req-e67830f6-6fbb-4ede-97f0-3e9f122c511d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lazy-loading 'fault' on Instance uuid d917f141-65db-49b0-87ed-0e1e0b72bb4a {{(pid=121339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:12:52.919083 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-060c921d-d259-4b53-9be3-c251b47b20fa tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:52.945562 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-060c921d-d259-4b53-9be3-c251b47b20fa tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1519 microversion: 2.1 time: 1.013719 Sep 01 14:12:52.953179 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 444/875] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:51 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1519 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:12:52.975448 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-e67830f6-6fbb-4ede-97f0-3e9f122c511d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77b0f8fe6dde4842bb3d03150ebe9916', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adf6f1699a0740ee99ae03ef2423d143', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:52.975943 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-58cf8e5d-9c34-413b-a4e5-477d11a1158d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:52.976907 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-58cf8e5d-9c34-413b-a4e5-477d11a1158d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:52.993190 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-58cf8e5d-9c34-413b-a4e5-477d11a1158d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:52.993685 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-58cf8e5d-9c34-413b-a4e5-477d11a1158d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:52.999702 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-e67830f6-6fbb-4ede-97f0-3e9f122c511d tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 200 len: 1348 microversion: 2.1 time: 0.521077 Sep 01 14:12:53.000019 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-58cf8e5d-9c34-413b-a4e5-477d11a1158d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:53.007514 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-58cf8e5d-9c34-413b-a4e5-477d11a1158d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:53.008478 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 432/876] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:52 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 1348 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:12:53.010393 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-58cf8e5d-9c34-413b-a4e5-477d11a1158d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:53.010900 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-58cf8e5d-9c34-413b-a4e5-477d11a1158d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:53.019851 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-fe6e6f1e-d8dc-42f0-9738-5d86991a186d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:53.038857 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-fe6e6f1e-d8dc-42f0-9738-5d86991a186d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:53.053122 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fe6e6f1e-d8dc-42f0-9738-5d86991a186d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:53.060304 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fe6e6f1e-d8dc-42f0-9738-5d86991a186d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:53.060304 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fe6e6f1e-d8dc-42f0-9738-5d86991a186d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:53.064416 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fe6e6f1e-d8dc-42f0-9738-5d86991a186d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:53.065663 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fe6e6f1e-d8dc-42f0-9738-5d86991a186d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:53.066828 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fe6e6f1e-d8dc-42f0-9738-5d86991a186d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:53.456717 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.objects.instance [None req-fe6e6f1e-d8dc-42f0-9738-5d86991a186d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lazy-loading 'services' on Instance uuid 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce {{(pid=121339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:12:53.507159 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-58cf8e5d-9c34-413b-a4e5-477d11a1158d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:53.517713 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-58cf8e5d-9c34-413b-a4e5-477d11a1158d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:53.519471 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-58cf8e5d-9c34-413b-a4e5-477d11a1158d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:53.520709 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-58cf8e5d-9c34-413b-a4e5-477d11a1158d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1738 microversion: 2.20 time: 0.565228 Sep 01 14:12:53.521258 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 445/877] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:12:52 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1738 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:12:53.975167 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-73a1dae3-a514-40d1-b70e-9c065cd275d0 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:53.976098 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-73a1dae3-a514-40d1-b70e-9c065cd275d0 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:53.988090 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-73a1dae3-a514-40d1-b70e-9c065cd275d0 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:53.988984 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-73a1dae3-a514-40d1-b70e-9c065cd275d0 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:53.989752 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-73a1dae3-a514-40d1-b70e-9c065cd275d0 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:53.991002 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-73a1dae3-a514-40d1-b70e-9c065cd275d0 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:53.991780 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-73a1dae3-a514-40d1-b70e-9c065cd275d0 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:53.992475 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-73a1dae3-a514-40d1-b70e-9c065cd275d0 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:54.231643 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-fe6e6f1e-d8dc-42f0-9738-5d86991a186d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce/os-volume_attachments/f8d04e4a-1847-4667-8d29-09f787a7251e" status: 202 len: 0 microversion: 2.1 time: 1.216732 Sep 01 14:12:54.241256 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 433/878] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Sep 1 14:12:53 2022] DELETE /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce/os-volume_attachments/f8d04e4a-1847-4667-8d29-09f787a7251e => generated 0 bytes in 1232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:12:54.288738 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-3232c18e-f66b-4ea2-88d2-a4fd35f5be0b tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:54.290052 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-3232c18e-f66b-4ea2-88d2-a4fd35f5be0b tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] [instance: d917f141-65db-49b0-87ed-0e1e0b72bb4a] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:54.342914 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3232c18e-f66b-4ea2-88d2-a4fd35f5be0b tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:54.344433 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3232c18e-f66b-4ea2-88d2-a4fd35f5be0b tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:54.346637 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3232c18e-f66b-4ea2-88d2-a4fd35f5be0b tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:54.348708 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3232c18e-f66b-4ea2-88d2-a4fd35f5be0b tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:54.351184 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3232c18e-f66b-4ea2-88d2-a4fd35f5be0b tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:54.352411 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3232c18e-f66b-4ea2-88d2-a4fd35f5be0b tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:54.394115 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.wsgi [None req-3232c18e-f66b-4ea2-88d2-a4fd35f5be0b tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] HTTP exception thrown: Instance d917f141-65db-49b0-87ed-0e1e0b72bb4a could not be found. Sep 01 14:12:54.398037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-3232c18e-f66b-4ea2-88d2-a4fd35f5be0b tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Request method failure captured: Sep 01 14:12:54.398037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: request: GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a HTTP/1.1 Sep 01 14:12:54.398037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept: application/json Sep 01 14:12:54.398037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept-Encoding: identity Sep 01 14:12:54.398037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Connection: close Sep 01 14:12:54.398037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Length: 0 Sep 01 14:12:54.398037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Type: application/json Sep 01 14:12:54.398037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Host: 10.222.0.25 Sep 01 14:12:54.398037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Openstack-System-Scope: None Sep 01 14:12:54.398037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: User-Agent: python-urllib3/1.26.12 Sep 01 14:12:54.398037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Auth-Token: gAAAAABjEL0XukfFJJ4QURlpKekkvRSVYBH242Ozn4QdoZOxut0t2esEf_G_2_SVJfv53iZ_7eXencfvFinsyIeUmgRXs6Y9V9IfNM1aI3it1LjGfAbtLdW667QQWe0Ws3NufUQAnR4o7eZh5FpG42InbL-75008FvCBmmDDdKMQqJQib0jaWUs Sep 01 14:12:54.398037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Id: None Sep 01 14:12:54.398037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Name: None Sep 01 14:12:54.398037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Identity-Status: Confirmed Sep 01 14:12:54.398037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Is-Admin-Project: True Sep 01 14:12:54.398037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Id: default Sep 01 14:12:54.398037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Name: Default Sep 01 14:12:54.398037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Id: adf6f1699a0740ee99ae03ef2423d143 Sep 01 14:12:54.398037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Name: tempest-TestMinimumBasicScenario-176715321 Sep 01 14:12:54.398037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Role: member,reader Sep 01 14:12:54.398037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Roles: member,reader Sep 01 14:12:54.401031 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/adf6f1699a0740ee99ae03ef2423d143"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/adf6f1699a0740ee99ae03ef2423d143"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/adf6f1699a0740ee99ae03ef2423d143"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_adf6f1699a0740ee99ae03ef2423d143"}]}] Sep 01 14:12:54.401031 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant: tempest-TestMinimumBasicScenario-176715321 Sep 01 14:12:54.401031 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Id: adf6f1699a0740ee99ae03ef2423d143 Sep 01 14:12:54.401031 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Name: tempest-TestMinimumBasicScenario-176715321 Sep 01 14:12:54.401031 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User: tempest-TestMinimumBasicScenario-176715321-project Sep 01 14:12:54.401031 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Id: default Sep 01 14:12:54.401031 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Name: Default Sep 01 14:12:54.401031 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Id: 77b0f8fe6dde4842bb3d03150ebe9916 Sep 01 14:12:54.401031 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Name: tempest-TestMinimumBasicScenario-176715321-project Sep 01 14:12:54.401031 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: method: > Sep 01 14:12:54.401031 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: exception: Instance d917f141-65db-49b0-87ed-0e1e0b72bb4a could not be found. Sep 01 14:12:54.401031 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: action_args: {'id': 'd917f141-65db-49b0-87ed-0e1e0b72bb4a'} Sep 01 14:12:54.412437 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:12:54.412437 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:12:54.412437 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:12:54.412437 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:12:54.412437 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:12:54.412437 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:12:54.412437 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:12:54.412437 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:12:54.412437 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:12:54.412437 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:12:54.412437 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d917f141-65db-49b0-87ed-0e1e0b72bb4a could not be found. Sep 01 14:12:54.412437 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:12:54.412437 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:12:54.412437 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:12:54.412437 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:12:54.412437 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:12:54.412437 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:12:54.412437 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:12:54.412437 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:12:54.412437 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:12:54.416115 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:12:54.416115 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:12:54.416115 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:12:54.416115 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:12:54.416115 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:12:54.416115 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:12:54.416115 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:12:54.416115 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d917f141-65db-49b0-87ed-0e1e0b72bb4a could not be found. Sep 01 14:12:54.416115 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:12:54.416115 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:12:54.416115 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:12:54.416115 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:12:54.416115 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:12:54.416115 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:12:54.416115 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:12:54.416115 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:12:54.416115 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d917f141-65db-49b0-87ed-0e1e0b72bb4a could not be found. Sep 01 14:12:54.416115 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:12:54.418924 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-3232c18e-f66b-4ea2-88d2-a4fd35f5be0b tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Returning 404 to user: Instance d917f141-65db-49b0-87ed-0e1e0b72bb4a could not be found. {{(pid=121339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:12:54.418924 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-3232c18e-f66b-4ea2-88d2-a4fd35f5be0b tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a" status: 404 len: 111 microversion: 2.1 time: 0.162694 Sep 01 14:12:54.431506 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 434/879] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:54 2022] GET /compute/v2.1/servers/d917f141-65db-49b0-87ed-0e1e0b72bb4a => generated 111 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:12:54.457667 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-d9ec1789-d898-4516-a5da-3df0d26bfc9f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:54.468309 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-d9ec1789-d898-4516-a5da-3df0d26bfc9f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:54.469039 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-73a1dae3-a514-40d1-b70e-9c065cd275d0 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:54.482021 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-73a1dae3-a514-40d1-b70e-9c065cd275d0 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1519 microversion: 2.1 time: 0.514504 Sep 01 14:12:54.490124 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 446/880] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:53 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1519 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:12:54.513400 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-3ef4ef35-6c7c-412b-af29-baf9fa286fda tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] Calling method '.version_select at 0x7f98678d5c10>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:54.528063 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d9ec1789-d898-4516-a5da-3df0d26bfc9f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:54.543753 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d9ec1789-d898-4516-a5da-3df0d26bfc9f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:54.544538 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d9ec1789-d898-4516-a5da-3df0d26bfc9f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:54.547794 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d9ec1789-d898-4516-a5da-3df0d26bfc9f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:54.548526 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d9ec1789-d898-4516-a5da-3df0d26bfc9f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:54.549190 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d9ec1789-d898-4516-a5da-3df0d26bfc9f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:54.702758 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-3ef4ef35-6c7c-412b-af29-baf9fa286fda tempest-TestMinimumBasicScenario-176715321 tempest-TestMinimumBasicScenario-176715321-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2074330713" status: 202 len: 0 microversion: 2.1 time: 0.211241 Sep 01 14:12:54.706906 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 447/881] 10.222.0.25 () {58 vars in 1272 bytes} [Thu Sep 1 14:12:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2074330713 => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:12:54.721851 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-462fd35f-3106-470f-80b8-c9273a32cdb6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:54.721851 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-462fd35f-3106-470f-80b8-c9273a32cdb6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:54.731568 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-d9ec1789-d898-4516-a5da-3df0d26bfc9f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.297128 Sep 01 14:12:54.734752 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 435/882] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 14:12:54 2022] GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce/os-volume_attachments => generated 197 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:12:54.769887 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-462fd35f-3106-470f-80b8-c9273a32cdb6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:54.771232 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-462fd35f-3106-470f-80b8-c9273a32cdb6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:54.772421 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-462fd35f-3106-470f-80b8-c9273a32cdb6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:54.777184 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-462fd35f-3106-470f-80b8-c9273a32cdb6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:54.781064 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-462fd35f-3106-470f-80b8-c9273a32cdb6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:54.781784 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-462fd35f-3106-470f-80b8-c9273a32cdb6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:55.076421 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-462fd35f-3106-470f-80b8-c9273a32cdb6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:55.139609 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-462fd35f-3106-470f-80b8-c9273a32cdb6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:55.150462 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-462fd35f-3106-470f-80b8-c9273a32cdb6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:55.153556 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-462fd35f-3106-470f-80b8-c9273a32cdb6 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1738 microversion: 2.20 time: 0.448301 Sep 01 14:12:55.165976 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 448/883] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:12:54 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1738 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:12:55.504844 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-45840a8e-8c65-4df6-b215-2a9c7df9e06c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:55.505581 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-45840a8e-8c65-4df6-b215-2a9c7df9e06c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:55.516622 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-45840a8e-8c65-4df6-b215-2a9c7df9e06c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:55.517115 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-45840a8e-8c65-4df6-b215-2a9c7df9e06c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:55.517536 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-45840a8e-8c65-4df6-b215-2a9c7df9e06c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:55.531709 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-45840a8e-8c65-4df6-b215-2a9c7df9e06c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:55.532327 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-45840a8e-8c65-4df6-b215-2a9c7df9e06c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:55.532777 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-45840a8e-8c65-4df6-b215-2a9c7df9e06c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:55.746422 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-076e4290-4f40-4e93-8bb0-24fb90b38b1e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:55.749162 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-076e4290-4f40-4e93-8bb0-24fb90b38b1e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:55.762123 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-076e4290-4f40-4e93-8bb0-24fb90b38b1e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:55.764572 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-076e4290-4f40-4e93-8bb0-24fb90b38b1e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:55.765028 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-076e4290-4f40-4e93-8bb0-24fb90b38b1e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:55.765851 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-076e4290-4f40-4e93-8bb0-24fb90b38b1e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:55.766346 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-076e4290-4f40-4e93-8bb0-24fb90b38b1e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:55.772558 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-076e4290-4f40-4e93-8bb0-24fb90b38b1e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:55.835764 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell1:UPDATE=5,nova_cell1:SELECT=92,nova_cell1:INSERT=3 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:12:55.851415 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-076e4290-4f40-4e93-8bb0-24fb90b38b1e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109583 Sep 01 14:12:55.856634 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 449/884] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 14:12:55 2022] GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:12:56.067944 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-45840a8e-8c65-4df6-b215-2a9c7df9e06c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:56.083585 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-45840a8e-8c65-4df6-b215-2a9c7df9e06c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1575 microversion: 2.1 time: 0.582475 Sep 01 14:12:56.084424 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 436/885] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:55 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1575 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:12:56.191435 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-48663c6d-a5b8-43be-bfd0-97750cb658d7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:56.192857 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-48663c6d-a5b8-43be-bfd0-97750cb658d7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:56.236033 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-48663c6d-a5b8-43be-bfd0-97750cb658d7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:56.237210 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-48663c6d-a5b8-43be-bfd0-97750cb658d7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:56.244378 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-48663c6d-a5b8-43be-bfd0-97750cb658d7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:56.245515 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-48663c6d-a5b8-43be-bfd0-97750cb658d7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:56.246393 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-48663c6d-a5b8-43be-bfd0-97750cb658d7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:56.250038 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-48663c6d-a5b8-43be-bfd0-97750cb658d7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:56.868470 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-51ce9a90-ec4c-4d8a-ae9c-8a71b77f60ee tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:56.871455 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-51ce9a90-ec4c-4d8a-ae9c-8a71b77f60ee tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:56.897145 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-51ce9a90-ec4c-4d8a-ae9c-8a71b77f60ee tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:56.897577 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-51ce9a90-ec4c-4d8a-ae9c-8a71b77f60ee tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:56.910463 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-51ce9a90-ec4c-4d8a-ae9c-8a71b77f60ee tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:56.924520 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-51ce9a90-ec4c-4d8a-ae9c-8a71b77f60ee tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:56.925375 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-51ce9a90-ec4c-4d8a-ae9c-8a71b77f60ee tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:56.926189 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-51ce9a90-ec4c-4d8a-ae9c-8a71b77f60ee tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:57.100066 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:12:57.167691 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-51ce9a90-ec4c-4d8a-ae9c-8a71b77f60ee tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.303524 Sep 01 14:12:57.169289 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 437/886] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 14:12:56 2022] GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce/os-volume_attachments => generated 197 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:12:57.182752 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-e7329d6a-bdd7-4728-a25f-b5060d291133 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:57.188432 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-e7329d6a-bdd7-4728-a25f-b5060d291133 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:57.213809 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e7329d6a-bdd7-4728-a25f-b5060d291133 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:57.214931 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e7329d6a-bdd7-4728-a25f-b5060d291133 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:57.216055 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e7329d6a-bdd7-4728-a25f-b5060d291133 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:57.224625 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e7329d6a-bdd7-4728-a25f-b5060d291133 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:57.226581 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e7329d6a-bdd7-4728-a25f-b5060d291133 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:57.227603 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e7329d6a-bdd7-4728-a25f-b5060d291133 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:57.282195 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-48663c6d-a5b8-43be-bfd0-97750cb658d7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:57.300996 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-48663c6d-a5b8-43be-bfd0-97750cb658d7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:57.309263 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-48663c6d-a5b8-43be-bfd0-97750cb658d7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:57.311173 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-48663c6d-a5b8-43be-bfd0-97750cb658d7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1738 microversion: 2.20 time: 1.130608 Sep 01 14:12:57.319284 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 450/887] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:12:56 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1738 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:12:57.663313 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-e7329d6a-bdd7-4728-a25f-b5060d291133 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:57.690176 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-e7329d6a-bdd7-4728-a25f-b5060d291133 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1575 microversion: 2.1 time: 0.517828 Sep 01 14:12:57.709499 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 438/888] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:57 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1575 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:12:58.193761 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-71ad4402-2310-40e6-92e5-1d74cbfd8355 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:58.202288 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-71ad4402-2310-40e6-92e5-1d74cbfd8355 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:58.231112 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-71ad4402-2310-40e6-92e5-1d74cbfd8355 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:58.231983 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-71ad4402-2310-40e6-92e5-1d74cbfd8355 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:58.232711 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-71ad4402-2310-40e6-92e5-1d74cbfd8355 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:58.234364 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-71ad4402-2310-40e6-92e5-1d74cbfd8355 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:58.235111 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-71ad4402-2310-40e6-92e5-1d74cbfd8355 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:58.236060 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-71ad4402-2310-40e6-92e5-1d74cbfd8355 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:58.328155 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-71ad4402-2310-40e6-92e5-1d74cbfd8355 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142820 Sep 01 14:12:58.329532 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 451/889] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 14:12:58 2022] GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:12:58.429881 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-fb483371-344a-4659-bde9-51f9921c3c4b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:58.436944 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-fb483371-344a-4659-bde9-51f9921c3c4b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:58.494394 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fb483371-344a-4659-bde9-51f9921c3c4b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:58.500074 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fb483371-344a-4659-bde9-51f9921c3c4b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:58.500968 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fb483371-344a-4659-bde9-51f9921c3c4b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:58.502347 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fb483371-344a-4659-bde9-51f9921c3c4b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:58.514973 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fb483371-344a-4659-bde9-51f9921c3c4b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:58.520734 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fb483371-344a-4659-bde9-51f9921c3c4b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:58.742956 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-37bd61a3-097d-4090-9a18-4d5fb490fc7f tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:58.743971 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-37bd61a3-097d-4090-9a18-4d5fb490fc7f tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:58.802061 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-37bd61a3-097d-4090-9a18-4d5fb490fc7f tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:58.802545 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-37bd61a3-097d-4090-9a18-4d5fb490fc7f tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:58.804400 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-37bd61a3-097d-4090-9a18-4d5fb490fc7f tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:58.809785 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-37bd61a3-097d-4090-9a18-4d5fb490fc7f tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:58.810772 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-37bd61a3-097d-4090-9a18-4d5fb490fc7f tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:58.811616 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-37bd61a3-097d-4090-9a18-4d5fb490fc7f tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:59.136559 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-fb483371-344a-4659-bde9-51f9921c3c4b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:59.148759 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-fb483371-344a-4659-bde9-51f9921c3c4b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:59.150666 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-fb483371-344a-4659-bde9-51f9921c3c4b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:59.152833 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-fb483371-344a-4659-bde9-51f9921c3c4b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1738 microversion: 2.20 time: 0.740142 Sep 01 14:12:59.153993 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 439/890] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:12:58 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1738 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:12:59.253044 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-37bd61a3-097d-4090-9a18-4d5fb490fc7f tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:59.263413 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-37bd61a3-097d-4090-9a18-4d5fb490fc7f tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1575 microversion: 2.1 time: 0.531336 Sep 01 14:12:59.275885 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 452/891] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:58 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1575 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:12:59.343692 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-fcbb52a8-e236-43a5-820b-44f697cf2dac tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:59.346064 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-fcbb52a8-e236-43a5-820b-44f697cf2dac tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:59.371279 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fcbb52a8-e236-43a5-820b-44f697cf2dac tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:59.372046 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fcbb52a8-e236-43a5-820b-44f697cf2dac tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:59.372651 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fcbb52a8-e236-43a5-820b-44f697cf2dac tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:59.374365 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fcbb52a8-e236-43a5-820b-44f697cf2dac tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:59.375060 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fcbb52a8-e236-43a5-820b-44f697cf2dac tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:59.375495 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fcbb52a8-e236-43a5-820b-44f697cf2dac tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:59.539618 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-fcbb52a8-e236-43a5-820b-44f697cf2dac tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092142 Sep 01 14:12:59.539618 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 440/892] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 14:12:59 2022] GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:13:00.195667 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-c2c00562-89a8-4d22-b5a6-fd1c58663801 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:00.196842 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-c2c00562-89a8-4d22-b5a6-fd1c58663801 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:00.207190 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c2c00562-89a8-4d22-b5a6-fd1c58663801 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:00.208619 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c2c00562-89a8-4d22-b5a6-fd1c58663801 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:00.208854 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c2c00562-89a8-4d22-b5a6-fd1c58663801 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:00.210115 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c2c00562-89a8-4d22-b5a6-fd1c58663801 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:00.210774 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c2c00562-89a8-4d22-b5a6-fd1c58663801 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:00.211273 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c2c00562-89a8-4d22-b5a6-fd1c58663801 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:00.330480 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-56c42e07-7aa3-49ee-aa58-6042546c2764 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:00.330906 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-56c42e07-7aa3-49ee-aa58-6042546c2764 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:00.374367 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-56c42e07-7aa3-49ee-aa58-6042546c2764 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:00.374693 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-56c42e07-7aa3-49ee-aa58-6042546c2764 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:00.375199 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-56c42e07-7aa3-49ee-aa58-6042546c2764 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:00.376275 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-56c42e07-7aa3-49ee-aa58-6042546c2764 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:00.377043 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-56c42e07-7aa3-49ee-aa58-6042546c2764 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:00.377709 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-56c42e07-7aa3-49ee-aa58-6042546c2764 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:00.537721 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-c2c00562-89a8-4d22-b5a6-fd1c58663801 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:00.570575 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-c2c00562-89a8-4d22-b5a6-fd1c58663801 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:00.574238 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-c2c00562-89a8-4d22-b5a6-fd1c58663801 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:00.576816 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-c2c00562-89a8-4d22-b5a6-fd1c58663801 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1738 microversion: 2.20 time: 0.386749 Sep 01 14:13:00.599187 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 453/893] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:13:00 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1738 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:13:00.611405 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-3447e9fb-8ace-4090-bb67-dad0f6485c1f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:00.627026 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-3447e9fb-8ace-4090-bb67-dad0f6485c1f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:00.639954 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3447e9fb-8ace-4090-bb67-dad0f6485c1f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:00.641371 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3447e9fb-8ace-4090-bb67-dad0f6485c1f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:00.644780 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3447e9fb-8ace-4090-bb67-dad0f6485c1f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:00.647364 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3447e9fb-8ace-4090-bb67-dad0f6485c1f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:00.648411 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3447e9fb-8ace-4090-bb67-dad0f6485c1f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:00.650018 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3447e9fb-8ace-4090-bb67-dad0f6485c1f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:00.718447 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-3447e9fb-8ace-4090-bb67-dad0f6485c1f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116398 Sep 01 14:13:00.726577 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 454/894] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 14:13:00 2022] GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:13:00.805970 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-56c42e07-7aa3-49ee-aa58-6042546c2764 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:00.816927 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-56c42e07-7aa3-49ee-aa58-6042546c2764 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1575 microversion: 2.1 time: 0.504759 Sep 01 14:13:00.817532 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 441/895] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:00 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1575 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:01.625573 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-a3091f5f-f8d8-46ba-8a30-fe5c52920f35 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:01.627869 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-a3091f5f-f8d8-46ba-8a30-fe5c52920f35 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:01.669934 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a3091f5f-f8d8-46ba-8a30-fe5c52920f35 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:01.679827 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a3091f5f-f8d8-46ba-8a30-fe5c52920f35 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:01.682764 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a3091f5f-f8d8-46ba-8a30-fe5c52920f35 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:01.683958 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a3091f5f-f8d8-46ba-8a30-fe5c52920f35 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:01.694672 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a3091f5f-f8d8-46ba-8a30-fe5c52920f35 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:01.696200 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a3091f5f-f8d8-46ba-8a30-fe5c52920f35 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:01.739287 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-24abade1-ec8a-4f89-8a05-7c166ddd67bc tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:01.755009 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-24abade1-ec8a-4f89-8a05-7c166ddd67bc tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:01.782794 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-24abade1-ec8a-4f89-8a05-7c166ddd67bc tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:01.787472 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-24abade1-ec8a-4f89-8a05-7c166ddd67bc tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:01.788009 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-24abade1-ec8a-4f89-8a05-7c166ddd67bc tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:01.788942 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-24abade1-ec8a-4f89-8a05-7c166ddd67bc tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:01.789419 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-24abade1-ec8a-4f89-8a05-7c166ddd67bc tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:01.789857 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-24abade1-ec8a-4f89-8a05-7c166ddd67bc tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:01.893560 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-24abade1-ec8a-4f89-8a05-7c166ddd67bc tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.159363 Sep 01 14:13:01.901022 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 442/896] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 14:13:01 2022] GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:13:01.925587 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-b771be54-e393-4d0c-b178-4b5f7b36ef59 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:01.932896 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-b771be54-e393-4d0c-b178-4b5f7b36ef59 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:01.971404 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell0:SELECT=4 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:13:01.978350 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b771be54-e393-4d0c-b178-4b5f7b36ef59 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:01.981529 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b771be54-e393-4d0c-b178-4b5f7b36ef59 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:01.987877 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b771be54-e393-4d0c-b178-4b5f7b36ef59 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:01.987877 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b771be54-e393-4d0c-b178-4b5f7b36ef59 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:01.987877 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b771be54-e393-4d0c-b178-4b5f7b36ef59 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:01.987877 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b771be54-e393-4d0c-b178-4b5f7b36ef59 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:02.415055 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-a3091f5f-f8d8-46ba-8a30-fe5c52920f35 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:02.453551 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-a3091f5f-f8d8-46ba-8a30-fe5c52920f35 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:02.459043 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-a3091f5f-f8d8-46ba-8a30-fe5c52920f35 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:02.463775 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-a3091f5f-f8d8-46ba-8a30-fe5c52920f35 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1738 microversion: 2.20 time: 0.846844 Sep 01 14:13:02.465092 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 455/897] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:13:01 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1738 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:13:02.556097 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-b771be54-e393-4d0c-b178-4b5f7b36ef59 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:02.579851 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-b771be54-e393-4d0c-b178-4b5f7b36ef59 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1575 microversion: 2.1 time: 0.677208 Sep 01 14:13:02.593947 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 443/898] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:01 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1575 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:02.889524 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-dc69a464-c33f-4650-b889-d8474caad7cc tempest-VolumesGetTestJSON-2060297575 tempest-VolumesGetTestJSON-2060297575-project] Action: 'create', calling method: .version_select at 0x7f986786a1f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-761045086", "metadata": {"Type": "work"}}} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:13:02.909884 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-d15cfda2-e368-4275-9076-ac1f1a6fc99f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:02.914160 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-d15cfda2-e368-4275-9076-ac1f1a6fc99f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:02.927075 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d15cfda2-e368-4275-9076-ac1f1a6fc99f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:02.927846 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d15cfda2-e368-4275-9076-ac1f1a6fc99f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:02.938922 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d15cfda2-e368-4275-9076-ac1f1a6fc99f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:02.938922 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d15cfda2-e368-4275-9076-ac1f1a6fc99f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:02.938922 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d15cfda2-e368-4275-9076-ac1f1a6fc99f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:02.938922 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d15cfda2-e368-4275-9076-ac1f1a6fc99f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:03.001026 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-d15cfda2-e368-4275-9076-ac1f1a6fc99f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097004 Sep 01 14:13:03.013630 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 444/899] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 14:13:02 2022] GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:13:03.229502 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-b0c966ce-3f5f-4742-ae36-205f564d9325 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:03.235631 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-b0c966ce-3f5f-4742-ae36-205f564d9325 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 8a8b6392-8237-47f3-9a9b-7a80f18f71c3] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:03.251818 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b0c966ce-3f5f-4742-ae36-205f564d9325 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:03.253674 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b0c966ce-3f5f-4742-ae36-205f564d9325 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:03.254257 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b0c966ce-3f5f-4742-ae36-205f564d9325 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:03.255322 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b0c966ce-3f5f-4742-ae36-205f564d9325 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:03.259268 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b0c966ce-3f5f-4742-ae36-205f564d9325 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:03.260222 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b0c966ce-3f5f-4742-ae36-205f564d9325 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:03.357176 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-b0c966ce-3f5f-4742-ae36-205f564d9325 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126914 Sep 01 14:13:03.360282 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 445/900] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 14:13:03 2022] GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:13:03.393403 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-afeb2bd4-891b-4db5-8618-d82e869c832c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:03.403964 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-afeb2bd4-891b-4db5-8618-d82e869c832c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 8a8b6392-8237-47f3-9a9b-7a80f18f71c3] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:03.432760 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-afeb2bd4-891b-4db5-8618-d82e869c832c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:03.432760 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-afeb2bd4-891b-4db5-8618-d82e869c832c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:03.432760 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-afeb2bd4-891b-4db5-8618-d82e869c832c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:03.432760 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-afeb2bd4-891b-4db5-8618-d82e869c832c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:03.433559 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-afeb2bd4-891b-4db5-8618-d82e869c832c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:03.433559 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-afeb2bd4-891b-4db5-8618-d82e869c832c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:03.464967 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-afeb2bd4-891b-4db5-8618-d82e869c832c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3/os-volume_attachments/fa2d451b-0ddc-445a-ae44-c943aa83f1ba" status: 200 len: 194 microversion: 2.1 time: 0.095415 Sep 01 14:13:03.465778 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 446/901] 10.222.0.25 () {58 vars in 1413 bytes} [Thu Sep 1 14:13:03 2022] GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3/os-volume_attachments/fa2d451b-0ddc-445a-ae44-c943aa83f1ba => generated 194 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:13:03.518647 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-a1b74837-9fee-45a0-be09-a08bb323ed36 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:03.520138 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-a1b74837-9fee-45a0-be09-a08bb323ed36 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:03.530888 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a1b74837-9fee-45a0-be09-a08bb323ed36 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:03.531534 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a1b74837-9fee-45a0-be09-a08bb323ed36 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:03.532113 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a1b74837-9fee-45a0-be09-a08bb323ed36 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:03.534634 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a1b74837-9fee-45a0-be09-a08bb323ed36 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:03.535487 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a1b74837-9fee-45a0-be09-a08bb323ed36 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:03.536199 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a1b74837-9fee-45a0-be09-a08bb323ed36 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:03.781775 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-a1b74837-9fee-45a0-be09-a08bb323ed36 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:03.792136 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-a1b74837-9fee-45a0-be09-a08bb323ed36 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:03.793857 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-a1b74837-9fee-45a0-be09-a08bb323ed36 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:03.795854 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-a1b74837-9fee-45a0-be09-a08bb323ed36 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1738 microversion: 2.20 time: 0.285958 Sep 01 14:13:03.796508 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 447/902] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:13:03 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1738 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:13:03.802058 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-6bd8f219-3d81-4e01-8db1-0425762dd043 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:03.802961 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-6bd8f219-3d81-4e01-8db1-0425762dd043 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:03.811393 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6bd8f219-3d81-4e01-8db1-0425762dd043 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:03.812835 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6bd8f219-3d81-4e01-8db1-0425762dd043 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:03.813637 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6bd8f219-3d81-4e01-8db1-0425762dd043 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:03.814934 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6bd8f219-3d81-4e01-8db1-0425762dd043 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:03.815741 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6bd8f219-3d81-4e01-8db1-0425762dd043 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:03.816484 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6bd8f219-3d81-4e01-8db1-0425762dd043 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:04.119837 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-6bd8f219-3d81-4e01-8db1-0425762dd043 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:04.133344 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-6bd8f219-3d81-4e01-8db1-0425762dd043 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1575 microversion: 2.1 time: 0.335564 Sep 01 14:13:04.149092 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 448/903] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:03 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1575 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:04.155262 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-bd5db955-28e5-472b-8dee-5814d69350b8 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:04.157787 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-bd5db955-28e5-472b-8dee-5814d69350b8 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:04.168964 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-bd5db955-28e5-472b-8dee-5814d69350b8 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:04.168964 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-bd5db955-28e5-472b-8dee-5814d69350b8 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:04.168964 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-bd5db955-28e5-472b-8dee-5814d69350b8 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:04.168964 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-bd5db955-28e5-472b-8dee-5814d69350b8 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:04.169881 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-bd5db955-28e5-472b-8dee-5814d69350b8 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:04.169881 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-bd5db955-28e5-472b-8dee-5814d69350b8 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:04.243202 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-bd5db955-28e5-472b-8dee-5814d69350b8 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.092863 Sep 01 14:13:04.243805 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 449/904] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 14:13:04 2022] GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 14:13:04.831627 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-6b105ca9-7843-44f2-99e1-27f3cc561ecb tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:04.836628 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-6b105ca9-7843-44f2-99e1-27f3cc561ecb tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:04.894985 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6b105ca9-7843-44f2-99e1-27f3cc561ecb tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:04.898596 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6b105ca9-7843-44f2-99e1-27f3cc561ecb tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:04.902879 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6b105ca9-7843-44f2-99e1-27f3cc561ecb tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:04.910527 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6b105ca9-7843-44f2-99e1-27f3cc561ecb tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:04.912466 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6b105ca9-7843-44f2-99e1-27f3cc561ecb tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:04.921375 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6b105ca9-7843-44f2-99e1-27f3cc561ecb tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:05.081114 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-dc69a464-c33f-4650-b889-d8474caad7cc tempest-VolumesGetTestJSON-2060297575 tempest-VolumesGetTestJSON-2060297575-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.612704 Sep 01 14:13:05.091928 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 456/905] 10.222.0.25 () {60 vars in 1156 bytes} [Thu Sep 1 14:13:02 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2624 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 01 14:13:05.102716 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-f9c4093a-befc-4e8f-b8ea-e0ed5bcba576 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:05.105302 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-f9c4093a-befc-4e8f-b8ea-e0ed5bcba576 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:05.120481 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f9c4093a-befc-4e8f-b8ea-e0ed5bcba576 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:05.121408 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f9c4093a-befc-4e8f-b8ea-e0ed5bcba576 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:05.122198 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f9c4093a-befc-4e8f-b8ea-e0ed5bcba576 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:05.124239 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f9c4093a-befc-4e8f-b8ea-e0ed5bcba576 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:05.124889 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f9c4093a-befc-4e8f-b8ea-e0ed5bcba576 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:05.125587 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f9c4093a-befc-4e8f-b8ea-e0ed5bcba576 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:05.235858 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-f9c4093a-befc-4e8f-b8ea-e0ed5bcba576 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce] Going to try to terminate instance {{(pid=121340) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:13:05.721231 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-6b105ca9-7843-44f2-99e1-27f3cc561ecb tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:05.734579 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-f9c4093a-befc-4e8f-b8ea-e0ed5bcba576 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce" status: 204 len: 0 microversion: 2.1 time: 0.640808 Sep 01 14:13:05.738484 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 457/906] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 14:13:05 2022] DELETE /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce => generated 0 bytes in 643 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:13:05.741759 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-61f7068d-623b-4102-99df-6a25cc1a56c6 tempest-VolumesGetTestJSON-2060297575 tempest-VolumesGetTestJSON-2060297575-project] Calling method '.version_select at 0x7f98678e69d0>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:05.747096 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-6b105ca9-7843-44f2-99e1-27f3cc561ecb tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:05.750450 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-6b105ca9-7843-44f2-99e1-27f3cc561ecb tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:05.753239 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-6b105ca9-7843-44f2-99e1-27f3cc561ecb tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1720 microversion: 2.20 time: 0.932829 Sep 01 14:13:05.786951 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 450/907] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:13:04 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1720 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:13:05.834854 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-314e5cbe-8431-4c97-a680-5249461860d5 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:05.839123 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-314e5cbe-8431-4c97-a680-5249461860d5 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:05.861239 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-314e5cbe-8431-4c97-a680-5249461860d5 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:05.863164 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-314e5cbe-8431-4c97-a680-5249461860d5 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:05.865014 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-314e5cbe-8431-4c97-a680-5249461860d5 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:05.865225 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-61f7068d-623b-4102-99df-6a25cc1a56c6 tempest-VolumesGetTestJSON-2060297575 tempest-VolumesGetTestJSON-2060297575-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/d9d7c218-7c32-4bef-a76a-54074e3a544f" status: 200 len: 353 microversion: 2.1 time: 0.128035 Sep 01 14:13:05.867875 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-314e5cbe-8431-4c97-a680-5249461860d5 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:05.868751 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-314e5cbe-8431-4c97-a680-5249461860d5 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:05.869693 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-314e5cbe-8431-4c97-a680-5249461860d5 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:05.871981 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 458/908] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 1 14:13:05 2022] GET /compute/v2.1/os-volumes/d9d7c218-7c32-4bef-a76a-54074e3a544f => generated 353 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:13:05.879464 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-ba78daa6-5504-4758-84c1-73946ba94b66 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:05.886148 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-ba78daa6-5504-4758-84c1-73946ba94b66 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:05.912997 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ba78daa6-5504-4758-84c1-73946ba94b66 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:05.913734 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ba78daa6-5504-4758-84c1-73946ba94b66 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:05.914367 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ba78daa6-5504-4758-84c1-73946ba94b66 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:05.915316 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ba78daa6-5504-4758-84c1-73946ba94b66 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:05.917575 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ba78daa6-5504-4758-84c1-73946ba94b66 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:05.918053 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ba78daa6-5504-4758-84c1-73946ba94b66 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:06.198750 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-314e5cbe-8431-4c97-a680-5249461860d5 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:06.198750 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-314e5cbe-8431-4c97-a680-5249461860d5 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1575 microversion: 2.1 time: 0.361407 Sep 01 14:13:06.198750 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 451/909] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:05 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1575 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:06.198750 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-bc4f17d2-5e5d-49a1-96c7-90b5fc139615 tempest-VolumesGetTestJSON-2060297575 tempest-VolumesGetTestJSON-2060297575-project] Calling method '.version_select at 0x7f986b382310>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:06.199577 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-ba78daa6-5504-4758-84c1-73946ba94b66 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:06.206559 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-ba78daa6-5504-4758-84c1-73946ba94b66 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce" status: 200 len: 1684 microversion: 2.1 time: 0.332602 Sep 01 14:13:06.207720 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 459/910] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:05 2022] GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce => generated 1684 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:06.258995 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-bc4f17d2-5e5d-49a1-96c7-90b5fc139615 tempest-VolumesGetTestJSON-2060297575 tempest-VolumesGetTestJSON-2060297575-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/d9d7c218-7c32-4bef-a76a-54074e3a544f" status: 200 len: 353 microversion: 2.1 time: 0.083840 Sep 01 14:13:06.259693 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 452/911] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 1 14:13:06 2022] GET /compute/v2.1/os-volumes/d9d7c218-7c32-4bef-a76a-54074e3a544f => generated 353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:13:06.282082 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-7cac9c7a-38a8-4ee3-9e78-6256f5f1a508 tempest-VolumesGetTestJSON-2060297575 tempest-VolumesGetTestJSON-2060297575-project] Calling method '.version_select at 0x7f9867883790>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:06.489972 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-c0ee0c29-ea35-4c5b-a4ba-242e9ba10399 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2fc60575-8d2c-4176-801f-a3badc8fec00"}} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:13:06.493383 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-c0ee0c29-ea35-4c5b-a4ba-242e9ba10399 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 8a8b6392-8237-47f3-9a9b-7a80f18f71c3] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:06.501671 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c0ee0c29-ea35-4c5b-a4ba-242e9ba10399 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:06.502343 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c0ee0c29-ea35-4c5b-a4ba-242e9ba10399 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:06.502908 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c0ee0c29-ea35-4c5b-a4ba-242e9ba10399 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:06.504114 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c0ee0c29-ea35-4c5b-a4ba-242e9ba10399 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:06.504985 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c0ee0c29-ea35-4c5b-a4ba-242e9ba10399 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:06.505775 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c0ee0c29-ea35-4c5b-a4ba-242e9ba10399 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:06.609880 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-7cac9c7a-38a8-4ee3-9e78-6256f5f1a508 tempest-VolumesGetTestJSON-2060297575 tempest-VolumesGetTestJSON-2060297575-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/d9d7c218-7c32-4bef-a76a-54074e3a544f" status: 202 len: 0 microversion: 2.1 time: 0.334007 Sep 01 14:13:06.609880 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 460/912] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Sep 1 14:13:06 2022] DELETE /compute/v2.1/os-volumes/d9d7c218-7c32-4bef-a76a-54074e3a544f => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:13:06.619329 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-d3e25c7f-428c-4fde-bb38-27908f5581ec tempest-VolumesGetTestJSON-2060297575 tempest-VolumesGetTestJSON-2060297575-project] Calling method '.version_select at 0x7f986788b670>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:06.680222 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-d3e25c7f-428c-4fde-bb38-27908f5581ec tempest-VolumesGetTestJSON-2060297575 tempest-VolumesGetTestJSON-2060297575-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/d9d7c218-7c32-4bef-a76a-54074e3a544f" status: 200 len: 352 microversion: 2.1 time: 0.064986 Sep 01 14:13:06.682326 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 461/913] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 1 14:13:06 2022] GET /compute/v2.1/os-volumes/d9d7c218-7c32-4bef-a76a-54074e3a544f => generated 352 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:13:06.805059 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-87699f4d-dcd4-433e-a493-d62d89322aa7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:06.806543 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-87699f4d-dcd4-433e-a493-d62d89322aa7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:06.819892 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-87699f4d-dcd4-433e-a493-d62d89322aa7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:06.820677 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-87699f4d-dcd4-433e-a493-d62d89322aa7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:06.821646 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-87699f4d-dcd4-433e-a493-d62d89322aa7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:06.823360 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-87699f4d-dcd4-433e-a493-d62d89322aa7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:06.824567 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-87699f4d-dcd4-433e-a493-d62d89322aa7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:06.825476 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-87699f4d-dcd4-433e-a493-d62d89322aa7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:07.036861 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-87699f4d-dcd4-433e-a493-d62d89322aa7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:07.083121 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-87699f4d-dcd4-433e-a493-d62d89322aa7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:07.085136 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-87699f4d-dcd4-433e-a493-d62d89322aa7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:07.094329 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-87699f4d-dcd4-433e-a493-d62d89322aa7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1720 microversion: 2.20 time: 0.295482 Sep 01 14:13:07.112329 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 462/914] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:13:06 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1720 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:13:07.118677 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [req-d1cd3620-0143-4bfd-bc0d-36db83d31dac req-0440ba39-4485-4f95-bc0a-09f99b5c9b01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cc866f4-91c1-4384-b88a-5866ca150aea", "name": "network-vif-plugged", "status": "completed", "tag": "9b44c940-faa5-4df3-83f2-2d676ad70287"}]} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:13:07.130297 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-d1cd3620-0143-4bfd-bc0d-36db83d31dac req-0440ba39-4485-4f95-bc0a-09f99b5c9b01 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:07.131308 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-d1cd3620-0143-4bfd-bc0d-36db83d31dac req-0440ba39-4485-4f95-bc0a-09f99b5c9b01 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:07.131941 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-d1cd3620-0143-4bfd-bc0d-36db83d31dac req-0440ba39-4485-4f95-bc0a-09f99b5c9b01 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:07.146743 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.compute.server_external_events [req-d1cd3620-0143-4bfd-bc0d-36db83d31dac req-0440ba39-4485-4f95-bc0a-09f99b5c9b01 service nova] Creating event network-vif-plugged:9b44c940-faa5-4df3-83f2-2d676ad70287 for instance 3cc866f4-91c1-4384-b88a-5866ca150aea on hv-cinder-85221 Sep 01 14:13:07.152872 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [req-d1cd3620-0143-4bfd-bc0d-36db83d31dac req-0440ba39-4485-4f95-bc0a-09f99b5c9b01 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039117 Sep 01 14:13:07.154834 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 463/915] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:13:07.220134 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-ce61e3e7-18bd-4a8d-b55e-eca92e5a8586 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:07.221289 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-ce61e3e7-18bd-4a8d-b55e-eca92e5a8586 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:07.229232 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ce61e3e7-18bd-4a8d-b55e-eca92e5a8586 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:07.229740 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ce61e3e7-18bd-4a8d-b55e-eca92e5a8586 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:07.234517 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ce61e3e7-18bd-4a8d-b55e-eca92e5a8586 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:07.234517 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ce61e3e7-18bd-4a8d-b55e-eca92e5a8586 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:07.234517 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ce61e3e7-18bd-4a8d-b55e-eca92e5a8586 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:07.234517 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ce61e3e7-18bd-4a8d-b55e-eca92e5a8586 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:07.500429 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-ce61e3e7-18bd-4a8d-b55e-eca92e5a8586 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:07.533791 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-ce61e3e7-18bd-4a8d-b55e-eca92e5a8586 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1575 microversion: 2.1 time: 0.301825 Sep 01 14:13:07.546902 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 464/916] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:07 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1575 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:07.556327 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-bb72e0d1-50b5-496f-bbf0-f4007bad9efe tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:07.557549 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-bb72e0d1-50b5-496f-bbf0-f4007bad9efe tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:07.564948 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bb72e0d1-50b5-496f-bbf0-f4007bad9efe tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:07.565577 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bb72e0d1-50b5-496f-bbf0-f4007bad9efe tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:07.566251 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bb72e0d1-50b5-496f-bbf0-f4007bad9efe tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:07.567272 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bb72e0d1-50b5-496f-bbf0-f4007bad9efe tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:07.567928 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bb72e0d1-50b5-496f-bbf0-f4007bad9efe tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:07.568361 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-bb72e0d1-50b5-496f-bbf0-f4007bad9efe tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:07.768146 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-bb72e0d1-50b5-496f-bbf0-f4007bad9efe tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:07.778329 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-bb72e0d1-50b5-496f-bbf0-f4007bad9efe tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce" status: 200 len: 1684 microversion: 2.1 time: 0.229269 Sep 01 14:13:07.790438 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 465/917] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:07 2022] GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce => generated 1684 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:07.797645 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-81bba215-3b07-43d4-9286-691d4382b8c7 tempest-VolumesGetTestJSON-2060297575 tempest-VolumesGetTestJSON-2060297575-project] Calling method '.version_select at 0x7f98678f00d0>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:07.841179 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.wsgi [None req-81bba215-3b07-43d4-9286-691d4382b8c7 tempest-VolumesGetTestJSON-2060297575 tempest-VolumesGetTestJSON-2060297575-project] HTTP exception thrown: Volume d9d7c218-7c32-4bef-a76a-54074e3a544f could not be found. Sep 01 14:13:07.844523 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-81bba215-3b07-43d4-9286-691d4382b8c7 tempest-VolumesGetTestJSON-2060297575 tempest-VolumesGetTestJSON-2060297575-project] Request method failure captured: Sep 01 14:13:07.844523 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: request: GET /compute/v2.1/os-volumes/d9d7c218-7c32-4bef-a76a-54074e3a544f HTTP/1.1 Sep 01 14:13:07.844523 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept: application/json Sep 01 14:13:07.844523 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept-Encoding: identity Sep 01 14:13:07.844523 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Connection: close Sep 01 14:13:07.844523 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Length: 0 Sep 01 14:13:07.844523 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Type: application/json Sep 01 14:13:07.844523 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Host: 10.222.0.25 Sep 01 14:13:07.844523 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Openstack-System-Scope: None Sep 01 14:13:07.844523 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: User-Agent: python-urllib3/1.26.12 Sep 01 14:13:07.844523 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Auth-Token: gAAAAABjEL3uFkykHqimx1favAyrYpmcGeUqVzoVKnSkXpDHzCNhaS5y3mqXEBp99SLvIWtcuDxeWsmWP-lXXbIp5aW_aLAby3Y-FhXkdTVrD43WzDQQ2iqoO2Ti06XqRjNmPlvA8Wb2EPpe-vCtcmJdiYXCxyMJspafA4TNct20YdJNTgKy_jw Sep 01 14:13:07.844523 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Id: None Sep 01 14:13:07.844523 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Name: None Sep 01 14:13:07.844523 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Identity-Status: Confirmed Sep 01 14:13:07.844523 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Is-Admin-Project: True Sep 01 14:13:07.844523 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Id: default Sep 01 14:13:07.844523 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Name: Default Sep 01 14:13:07.844523 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Id: 9320dd382479483bb7b455a9801daf03 Sep 01 14:13:07.844523 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Name: tempest-VolumesGetTestJSON-2060297575 Sep 01 14:13:07.844523 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Role: member,reader Sep 01 14:13:07.844523 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Roles: member,reader Sep 01 14:13:07.855399 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9320dd382479483bb7b455a9801daf03"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/9320dd382479483bb7b455a9801daf03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/9320dd382479483bb7b455a9801daf03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_9320dd382479483bb7b455a9801daf03"}]}] Sep 01 14:13:07.855399 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant: tempest-VolumesGetTestJSON-2060297575 Sep 01 14:13:07.855399 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Id: 9320dd382479483bb7b455a9801daf03 Sep 01 14:13:07.855399 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Name: tempest-VolumesGetTestJSON-2060297575 Sep 01 14:13:07.855399 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User: tempest-VolumesGetTestJSON-2060297575-project Sep 01 14:13:07.855399 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Id: default Sep 01 14:13:07.855399 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Name: Default Sep 01 14:13:07.855399 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Id: c20db8c34b624787939432ebb4655978 Sep 01 14:13:07.855399 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Name: tempest-VolumesGetTestJSON-2060297575-project Sep 01 14:13:07.855399 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: method: Sep 01 14:13:07.855399 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: exception: Volume d9d7c218-7c32-4bef-a76a-54074e3a544f could not be found. Sep 01 14:13:07.855399 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: action_args: {'id': 'd9d7c218-7c32-4bef-a76a-54074e3a544f'} Sep 01 14:13:07.855399 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:13:07.859229 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:13:07.859229 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 14:13:07.859229 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 14:13:07.859229 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 14:13:07.859229 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 14:13:07.859229 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 14:13:07.859229 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 14:13:07.859229 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 14:13:07.859229 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 14:13:07.859229 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 14:13:07.859229 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 14:13:07.859229 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:13:07.859229 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:13:07.859229 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:13:07.859229 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:13:07.859229 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d9d7c218-7c32-4bef-a76a-54074e3a544f could not be found. (HTTP 404) (Request-ID: req-75b9bc3b-f3c2-41e3-b2b3-713522098444) Sep 01 14:13:07.859229 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:13:07.859229 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:13:07.859229 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:13:07.863138 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:13:07.863138 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 14:13:07.863138 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 14:13:07.863138 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 14:13:07.863138 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 14:13:07.863138 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 14:13:07.863138 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 14:13:07.863138 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 14:13:07.863138 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 14:13:07.863138 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 14:13:07.863138 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 14:13:07.863138 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 14:13:07.863138 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 14:13:07.863138 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 14:13:07.863138 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 14:13:07.863138 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 14:13:07.863138 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 14:13:07.863138 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 14:13:07.863138 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 14:13:07.866481 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:13:07.866481 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:13:07.866481 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:13:07.866481 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:13:07.866481 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d9d7c218-7c32-4bef-a76a-54074e3a544f could not be found. Sep 01 14:13:07.866481 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:13:07.866481 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:13:07.866481 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:13:07.866481 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:13:07.866481 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:13:07.866481 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:13:07.866481 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:13:07.866481 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:13:07.866481 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 14:13:07.866481 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 14:13:07.866481 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:13:07.866481 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:13:07.866481 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 14:13:07.866481 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:13:07.867948 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d9d7c218-7c32-4bef-a76a-54074e3a544f could not be found. Sep 01 14:13:07.867948 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:13:07.867948 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:13:07.867948 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:13:07.867948 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:13:07.867948 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:13:07.867948 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:13:07.867948 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:13:07.867948 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:13:07.867948 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d9d7c218-7c32-4bef-a76a-54074e3a544f could not be found. Sep 01 14:13:07.867948 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:13:07.867948 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-81bba215-3b07-43d4-9286-691d4382b8c7 tempest-VolumesGetTestJSON-2060297575 tempest-VolumesGetTestJSON-2060297575-project] Returning 404 to user: Volume d9d7c218-7c32-4bef-a76a-54074e3a544f could not be found. {{(pid=121340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:13:07.867948 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-81bba215-3b07-43d4-9286-691d4382b8c7 tempest-VolumesGetTestJSON-2060297575 tempest-VolumesGetTestJSON-2060297575-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/d9d7c218-7c32-4bef-a76a-54074e3a544f" status: 404 len: 109 microversion: 2.1 time: 0.054504 Sep 01 14:13:07.867948 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 466/918] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 1 14:13:07 2022] GET /compute/v2.1/os-volumes/d9d7c218-7c32-4bef-a76a-54074e3a544f => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:13:08.075389 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:13:08.126842 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-3965223f-e743-45d7-9d11-0368801693eb tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:08.129200 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-3965223f-e743-45d7-9d11-0368801693eb tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:08.168603 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3965223f-e743-45d7-9d11-0368801693eb tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:08.170715 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3965223f-e743-45d7-9d11-0368801693eb tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:08.172333 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3965223f-e743-45d7-9d11-0368801693eb tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:08.174466 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3965223f-e743-45d7-9d11-0368801693eb tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:08.175485 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3965223f-e743-45d7-9d11-0368801693eb tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:08.176401 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3965223f-e743-45d7-9d11-0368801693eb tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:08.202447 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-c0ee0c29-ea35-4c5b-a4ba-242e9ba10399 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "POST /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.713762 Sep 01 14:13:08.205065 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 453/919] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Sep 1 14:13:06 2022] POST /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3/os-volume_attachments => generated 194 bytes in 1723 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:13:08.448942 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-3965223f-e743-45d7-9d11-0368801693eb tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:08.460375 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-3965223f-e743-45d7-9d11-0368801693eb tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:08.461886 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-3965223f-e743-45d7-9d11-0368801693eb tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:08.463151 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-3965223f-e743-45d7-9d11-0368801693eb tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1720 microversion: 2.20 time: 0.343452 Sep 01 14:13:08.464106 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 467/920] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:13:08 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1720 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:13:08.569140 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-88cb5839-1acb-4cc6-8bdc-3961890c570a tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:08.570172 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-88cb5839-1acb-4cc6-8bdc-3961890c570a tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:08.579550 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-88cb5839-1acb-4cc6-8bdc-3961890c570a tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:08.580405 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-88cb5839-1acb-4cc6-8bdc-3961890c570a tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:08.581059 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-88cb5839-1acb-4cc6-8bdc-3961890c570a tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:08.582897 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-88cb5839-1acb-4cc6-8bdc-3961890c570a tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:08.583744 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-88cb5839-1acb-4cc6-8bdc-3961890c570a tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:08.584484 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-88cb5839-1acb-4cc6-8bdc-3961890c570a tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:08.797306 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-88cb5839-1acb-4cc6-8bdc-3961890c570a tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:08.814128 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-88cb5839-1acb-4cc6-8bdc-3961890c570a tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1575 microversion: 2.1 time: 0.250894 Sep 01 14:13:08.818677 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-cc5e4572-0f9c-4624-8cac-d15a5f7d7fa4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:08.822649 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-cc5e4572-0f9c-4624-8cac-d15a5f7d7fa4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:08.831315 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 454/921] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:08 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1575 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:08.855044 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-cc5e4572-0f9c-4624-8cac-d15a5f7d7fa4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:08.855806 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-cc5e4572-0f9c-4624-8cac-d15a5f7d7fa4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:08.856581 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-cc5e4572-0f9c-4624-8cac-d15a5f7d7fa4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:08.857961 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-cc5e4572-0f9c-4624-8cac-d15a5f7d7fa4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:08.858991 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-cc5e4572-0f9c-4624-8cac-d15a5f7d7fa4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:08.859936 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-cc5e4572-0f9c-4624-8cac-d15a5f7d7fa4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:08.954319 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-cc5e4572-0f9c-4624-8cac-d15a5f7d7fa4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:08.965414 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-cc5e4572-0f9c-4624-8cac-d15a5f7d7fa4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce" status: 200 len: 1616 microversion: 2.1 time: 0.161897 Sep 01 14:13:08.966579 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 468/922] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:08 2022] GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce => generated 1616 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:09.494440 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-3c235c6d-6a8d-4a3b-a97b-0a98ed1c5d7d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:09.496564 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-3c235c6d-6a8d-4a3b-a97b-0a98ed1c5d7d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:09.515833 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:13:09.522636 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3c235c6d-6a8d-4a3b-a97b-0a98ed1c5d7d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:09.523465 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3c235c6d-6a8d-4a3b-a97b-0a98ed1c5d7d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:09.525094 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3c235c6d-6a8d-4a3b-a97b-0a98ed1c5d7d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:09.531239 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3c235c6d-6a8d-4a3b-a97b-0a98ed1c5d7d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:09.532067 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3c235c6d-6a8d-4a3b-a97b-0a98ed1c5d7d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:09.532709 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3c235c6d-6a8d-4a3b-a97b-0a98ed1c5d7d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:09.838425 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-3c235c6d-6a8d-4a3b-a97b-0a98ed1c5d7d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:09.851342 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-99fe43a2-b2d2-4c9d-8f46-0239f6660fc7 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:09.852850 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-99fe43a2-b2d2-4c9d-8f46-0239f6660fc7 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:09.859808 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-3c235c6d-6a8d-4a3b-a97b-0a98ed1c5d7d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:09.861633 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-3c235c6d-6a8d-4a3b-a97b-0a98ed1c5d7d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:09.867582 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-99fe43a2-b2d2-4c9d-8f46-0239f6660fc7 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:09.868662 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-3c235c6d-6a8d-4a3b-a97b-0a98ed1c5d7d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1720 microversion: 2.20 time: 0.380788 Sep 01 14:13:09.869567 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-99fe43a2-b2d2-4c9d-8f46-0239f6660fc7 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:09.871436 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-99fe43a2-b2d2-4c9d-8f46-0239f6660fc7 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:09.871680 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 455/923] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:13:09 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1720 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:13:09.874031 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-99fe43a2-b2d2-4c9d-8f46-0239f6660fc7 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:09.876246 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-99fe43a2-b2d2-4c9d-8f46-0239f6660fc7 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:09.877439 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-99fe43a2-b2d2-4c9d-8f46-0239f6660fc7 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:09.980373 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [req-962a4533-b7d4-4cbb-9f6e-af0b34af267a req-f4cb89d8-8438-47d8-97c7-64565e5ec53a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce", "name": "network-vif-deleted", "tag": "13cc93c3-c869-44c3-b869-955e63001656"}]} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:13:09.993471 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-962a4533-b7d4-4cbb-9f6e-af0b34af267a req-f4cb89d8-8438-47d8-97c7-64565e5ec53a service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:09.994465 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-962a4533-b7d4-4cbb-9f6e-af0b34af267a req-f4cb89d8-8438-47d8-97c7-64565e5ec53a service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:09.995277 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-962a4533-b7d4-4cbb-9f6e-af0b34af267a req-f4cb89d8-8438-47d8-97c7-64565e5ec53a service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:10.010583 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.compute.server_external_events [req-962a4533-b7d4-4cbb-9f6e-af0b34af267a req-f4cb89d8-8438-47d8-97c7-64565e5ec53a service nova] Creating event network-vif-deleted:13cc93c3-c869-44c3-b869-955e63001656 for instance 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce on hv-cinder-85221 Sep 01 14:13:10.017876 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [req-962a4533-b7d4-4cbb-9f6e-af0b34af267a req-f4cb89d8-8438-47d8-97c7-64565e5ec53a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042093 Sep 01 14:13:10.019179 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 456/924] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:13:10.027411 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-5f4815fe-2801-4ae8-808d-90cbf52fb2eb tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:10.029087 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-5f4815fe-2801-4ae8-808d-90cbf52fb2eb tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:10.044379 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5f4815fe-2801-4ae8-808d-90cbf52fb2eb tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:10.044998 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5f4815fe-2801-4ae8-808d-90cbf52fb2eb tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:10.045472 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5f4815fe-2801-4ae8-808d-90cbf52fb2eb tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:10.046436 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5f4815fe-2801-4ae8-808d-90cbf52fb2eb tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:10.047112 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5f4815fe-2801-4ae8-808d-90cbf52fb2eb tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:10.047896 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5f4815fe-2801-4ae8-808d-90cbf52fb2eb tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:10.196158 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-99fe43a2-b2d2-4c9d-8f46-0239f6660fc7 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:10.196526 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-5f4815fe-2801-4ae8-808d-90cbf52fb2eb tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:10.208016 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-99fe43a2-b2d2-4c9d-8f46-0239f6660fc7 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1575 microversion: 2.1 time: 0.361394 Sep 01 14:13:10.208956 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 469/925] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:09 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1575 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:13:10.234398 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-5f4815fe-2801-4ae8-808d-90cbf52fb2eb tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce" status: 200 len: 1616 microversion: 2.1 time: 0.212565 Sep 01 14:13:10.235374 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 457/926] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:10 2022] GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce => generated 1616 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:10.928857 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-5950eae4-5794-4836-9695-18fca049b028 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:10.930149 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-5950eae4-5794-4836-9695-18fca049b028 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:10.960564 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5950eae4-5794-4836-9695-18fca049b028 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:10.961754 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5950eae4-5794-4836-9695-18fca049b028 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:10.963825 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5950eae4-5794-4836-9695-18fca049b028 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:10.985695 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5950eae4-5794-4836-9695-18fca049b028 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:10.988337 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5950eae4-5794-4836-9695-18fca049b028 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:10.989852 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5950eae4-5794-4836-9695-18fca049b028 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:11.041076 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:13:11.239598 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-22216891-36b8-4d8f-91df-5ee5a04cd416 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:11.244195 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-22216891-36b8-4d8f-91df-5ee5a04cd416 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:11.274679 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-22216891-36b8-4d8f-91df-5ee5a04cd416 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:11.280486 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-22216891-36b8-4d8f-91df-5ee5a04cd416 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:11.280486 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-22216891-36b8-4d8f-91df-5ee5a04cd416 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:11.282793 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-22216891-36b8-4d8f-91df-5ee5a04cd416 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:11.284023 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-22216891-36b8-4d8f-91df-5ee5a04cd416 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:11.286203 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-22216891-36b8-4d8f-91df-5ee5a04cd416 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:11.355851 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-5950eae4-5794-4836-9695-18fca049b028 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:11.376743 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-5950eae4-5794-4836-9695-18fca049b028 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:11.380850 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-5950eae4-5794-4836-9695-18fca049b028 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:11.384094 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-5950eae4-5794-4836-9695-18fca049b028 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1723 microversion: 2.20 time: 0.467993 Sep 01 14:13:11.438312 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 470/927] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:13:10 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1723 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:13:11.453290 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-ebb6744d-8321-4792-97d9-e5dd84c0ffc3 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:11.459588 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-ebb6744d-8321-4792-97d9-e5dd84c0ffc3 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:11.476596 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ebb6744d-8321-4792-97d9-e5dd84c0ffc3 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:11.478858 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ebb6744d-8321-4792-97d9-e5dd84c0ffc3 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:11.480499 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ebb6744d-8321-4792-97d9-e5dd84c0ffc3 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:11.482010 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ebb6744d-8321-4792-97d9-e5dd84c0ffc3 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:11.483146 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ebb6744d-8321-4792-97d9-e5dd84c0ffc3 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:11.489120 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ebb6744d-8321-4792-97d9-e5dd84c0ffc3 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:11.611958 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ebb6744d-8321-4792-97d9-e5dd84c0ffc3 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:11.615099 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ebb6744d-8321-4792-97d9-e5dd84c0ffc3 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:11.618141 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ebb6744d-8321-4792-97d9-e5dd84c0ffc3 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:11.619416 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.objects.instance [None req-ebb6744d-8321-4792-97d9-e5dd84c0ffc3 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lazy-loading 'fault' on Instance uuid 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce {{(pid=121340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:13:11.737528 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-ebb6744d-8321-4792-97d9-e5dd84c0ffc3 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:11.769477 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-ebb6744d-8321-4792-97d9-e5dd84c0ffc3 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce" status: 200 len: 1332 microversion: 2.1 time: 0.323832 Sep 01 14:13:11.795808 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 471/928] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:11 2022] GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce => generated 1332 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:11.815036 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-2be0354f-941a-472a-bff8-22b2019b27ea tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a1be753-c2e7-470e-8afb-196ab28da723"}} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:13:11.833240 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-2be0354f-941a-472a-bff8-22b2019b27ea tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:11.844249 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-22216891-36b8-4d8f-91df-5ee5a04cd416 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:11.867695 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2be0354f-941a-472a-bff8-22b2019b27ea tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:11.869170 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2be0354f-941a-472a-bff8-22b2019b27ea tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:11.870313 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2be0354f-941a-472a-bff8-22b2019b27ea tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:11.871886 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-22216891-36b8-4d8f-91df-5ee5a04cd416 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1562 microversion: 2.1 time: 0.646091 Sep 01 14:13:11.890882 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 458/929] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:11 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1562 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:11.892484 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2be0354f-941a-472a-bff8-22b2019b27ea tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:11.894107 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2be0354f-941a-472a-bff8-22b2019b27ea tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:11.898974 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2be0354f-941a-472a-bff8-22b2019b27ea tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:11.923553 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [req-17d33da6-6acd-42a9-a77a-4f6eb66531a0 req-89695182-9303-41df-a8d9-1bd960336608 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1", "name": "network-vif-unplugged", "status": "completed", "tag": "214b6ab8-206c-4129-a639-f69abbdaa49b"}]} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:13:11.954621 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-17d33da6-6acd-42a9-a77a-4f6eb66531a0 req-89695182-9303-41df-a8d9-1bd960336608 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:11.956074 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-17d33da6-6acd-42a9-a77a-4f6eb66531a0 req-89695182-9303-41df-a8d9-1bd960336608 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:11.962142 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-17d33da6-6acd-42a9-a77a-4f6eb66531a0 req-89695182-9303-41df-a8d9-1bd960336608 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:11.990944 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.compute.server_external_events [req-17d33da6-6acd-42a9-a77a-4f6eb66531a0 req-89695182-9303-41df-a8d9-1bd960336608 service nova] Creating event network-vif-unplugged:214b6ab8-206c-4129-a639-f69abbdaa49b for instance d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 on hv-cinder-85221 Sep 01 14:13:12.004034 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [req-17d33da6-6acd-42a9-a77a-4f6eb66531a0 req-89695182-9303-41df-a8d9-1bd960336608 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105841 Sep 01 14:13:12.005609 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 459/930] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:13:12.807348 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-d5a8d04e-005d-4c8f-8b7f-07e23a37fab2 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:12.808357 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-d5a8d04e-005d-4c8f-8b7f-07e23a37fab2 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:12.846391 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d5a8d04e-005d-4c8f-8b7f-07e23a37fab2 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:12.847224 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d5a8d04e-005d-4c8f-8b7f-07e23a37fab2 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:12.849179 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d5a8d04e-005d-4c8f-8b7f-07e23a37fab2 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:12.849179 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d5a8d04e-005d-4c8f-8b7f-07e23a37fab2 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:12.851064 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d5a8d04e-005d-4c8f-8b7f-07e23a37fab2 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:12.854400 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d5a8d04e-005d-4c8f-8b7f-07e23a37fab2 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:12.972470 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d5a8d04e-005d-4c8f-8b7f-07e23a37fab2 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:12.976225 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d5a8d04e-005d-4c8f-8b7f-07e23a37fab2 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:12.977268 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d5a8d04e-005d-4c8f-8b7f-07e23a37fab2 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:12.977469 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.objects.instance [None req-d5a8d04e-005d-4c8f-8b7f-07e23a37fab2 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lazy-loading 'fault' on Instance uuid 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce {{(pid=121339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:13:13.156151 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-d5a8d04e-005d-4c8f-8b7f-07e23a37fab2 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:13.168037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-d5a8d04e-005d-4c8f-8b7f-07e23a37fab2 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce" status: 200 len: 1332 microversion: 2.1 time: 0.364671 Sep 01 14:13:13.183187 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 460/931] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:12 2022] GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce => generated 1332 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:13.235286 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-6e846a83-620a-4ff7-99b3-3f57c5a4d6a9 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:13.239565 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-6e846a83-620a-4ff7-99b3-3f57c5a4d6a9 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 8a8b6392-8237-47f3-9a9b-7a80f18f71c3] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:13.248875 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6e846a83-620a-4ff7-99b3-3f57c5a4d6a9 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:13.252069 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6e846a83-620a-4ff7-99b3-3f57c5a4d6a9 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:13.253816 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6e846a83-620a-4ff7-99b3-3f57c5a4d6a9 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:13.255604 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6e846a83-620a-4ff7-99b3-3f57c5a4d6a9 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:13.257511 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6e846a83-620a-4ff7-99b3-3f57c5a4d6a9 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:13.259011 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6e846a83-620a-4ff7-99b3-3f57c5a4d6a9 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:13.496560 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-6e846a83-620a-4ff7-99b3-3f57c5a4d6a9 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.265795 Sep 01 14:13:13.497505 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 461/932] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 14:13:13 2022] GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3/os-volume_attachments => generated 371 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:13:13.648808 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-8a873390-33cf-40d9-939d-edac04f72a34 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:13.649369 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-8a873390-33cf-40d9-939d-edac04f72a34 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 8a8b6392-8237-47f3-9a9b-7a80f18f71c3] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:13.660430 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8a873390-33cf-40d9-939d-edac04f72a34 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:13.661271 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8a873390-33cf-40d9-939d-edac04f72a34 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:13.662527 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8a873390-33cf-40d9-939d-edac04f72a34 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:13.663751 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8a873390-33cf-40d9-939d-edac04f72a34 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:13.664824 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8a873390-33cf-40d9-939d-edac04f72a34 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:13.666445 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8a873390-33cf-40d9-939d-edac04f72a34 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:13.687854 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-2be0354f-941a-472a-bff8-22b2019b27ea tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "POST /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.888949 Sep 01 14:13:13.689311 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 472/933] 10.222.0.25 () {62 vars in 1364 bytes} [Thu Sep 1 14:13:11 2022] POST /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1/os-volume_attachments => generated 188 bytes in 1893 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 14:13:13.734594 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-8a873390-33cf-40d9-939d-edac04f72a34 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3/os-volume_attachments/fa2d451b-0ddc-445a-ae44-c943aa83f1ba" status: 200 len: 194 microversion: 2.1 time: 0.089689 Sep 01 14:13:13.744293 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 462/934] 10.222.0.25 () {58 vars in 1413 bytes} [Thu Sep 1 14:13:13 2022] GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3/os-volume_attachments/fa2d451b-0ddc-445a-ae44-c943aa83f1ba => generated 194 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:13:13.754700 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-372f334e-6f03-4396-b043-c8b3fdebe35a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:13.756494 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-372f334e-6f03-4396-b043-c8b3fdebe35a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 8a8b6392-8237-47f3-9a9b-7a80f18f71c3] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:13.783681 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-372f334e-6f03-4396-b043-c8b3fdebe35a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:13.785352 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-372f334e-6f03-4396-b043-c8b3fdebe35a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:13.795870 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-372f334e-6f03-4396-b043-c8b3fdebe35a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:13.795870 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-372f334e-6f03-4396-b043-c8b3fdebe35a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:13.826050 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-372f334e-6f03-4396-b043-c8b3fdebe35a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:13.826762 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-372f334e-6f03-4396-b043-c8b3fdebe35a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:14.064046 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-4788b01b-55c1-47e1-80d4-21e112d79d0c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:14.064860 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-4788b01b-55c1-47e1-80d4-21e112d79d0c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:14.087921 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4788b01b-55c1-47e1-80d4-21e112d79d0c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:14.089849 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4788b01b-55c1-47e1-80d4-21e112d79d0c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:14.090991 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4788b01b-55c1-47e1-80d4-21e112d79d0c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:14.093252 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4788b01b-55c1-47e1-80d4-21e112d79d0c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:14.094394 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4788b01b-55c1-47e1-80d4-21e112d79d0c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:14.095227 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4788b01b-55c1-47e1-80d4-21e112d79d0c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:14.112356 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.objects.instance [None req-372f334e-6f03-4396-b043-c8b3fdebe35a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lazy-loading 'services' on Instance uuid 8a8b6392-8237-47f3-9a9b-7a80f18f71c3 {{(pid=121340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:13:14.622633 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-372f334e-6f03-4396-b043-c8b3fdebe35a tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3/os-volume_attachments/fa2d451b-0ddc-445a-ae44-c943aa83f1ba" status: 202 len: 0 microversion: 2.1 time: 0.875000 Sep 01 14:13:14.624532 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 473/935] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Sep 1 14:13:13 2022] DELETE /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3/os-volume_attachments/fa2d451b-0ddc-445a-ae44-c943aa83f1ba => generated 0 bytes in 879 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:13:14.633882 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-e1c080eb-d8e5-4af0-a344-8c897d2e87d4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:14.634939 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-e1c080eb-d8e5-4af0-a344-8c897d2e87d4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:14.647964 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e1c080eb-d8e5-4af0-a344-8c897d2e87d4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:14.647964 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e1c080eb-d8e5-4af0-a344-8c897d2e87d4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:14.649552 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e1c080eb-d8e5-4af0-a344-8c897d2e87d4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:14.651087 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e1c080eb-d8e5-4af0-a344-8c897d2e87d4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:14.651808 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e1c080eb-d8e5-4af0-a344-8c897d2e87d4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:14.652453 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e1c080eb-d8e5-4af0-a344-8c897d2e87d4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:14.674794 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.wsgi [None req-e1c080eb-d8e5-4af0-a344-8c897d2e87d4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] HTTP exception thrown: Instance 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce could not be found. Sep 01 14:13:14.677245 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-e1c080eb-d8e5-4af0-a344-8c897d2e87d4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Request method failure captured: Sep 01 14:13:14.677245 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: request: GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce HTTP/1.1 Sep 01 14:13:14.677245 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept: application/json Sep 01 14:13:14.677245 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept-Encoding: identity Sep 01 14:13:14.677245 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Connection: close Sep 01 14:13:14.677245 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Length: 0 Sep 01 14:13:14.677245 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Type: application/json Sep 01 14:13:14.677245 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Host: 10.222.0.25 Sep 01 14:13:14.677245 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Openstack-System-Scope: None Sep 01 14:13:14.677245 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: User-Agent: python-urllib3/1.26.12 Sep 01 14:13:14.677245 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Auth-Token: gAAAAABjELyhZj5Hr9I4grX9g-sLmSzxOFwV6C8_UuPsJu0TTboeG4lPJ1EtlgmTO6Q18ohdm_zKgQxmrLRlDi5SpU-ZjSVzLIRa5u6LBsCTR0TutJimllLkII0Ts1UxHVT4475s7UI-5uK5aNVzYOSUMxaGRq9ZaCGPwi2wkROzwm6JUQLDfLI Sep 01 14:13:14.677245 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Id: None Sep 01 14:13:14.677245 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Name: None Sep 01 14:13:14.677245 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Identity-Status: Confirmed Sep 01 14:13:14.677245 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Is-Admin-Project: True Sep 01 14:13:14.677245 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Id: default Sep 01 14:13:14.677245 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Name: Default Sep 01 14:13:14.677245 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Id: 90a84500a899479aabfa3aeb72b4c4ae Sep 01 14:13:14.677245 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Name: tempest-AttachVolumeNegativeTest-836381067 Sep 01 14:13:14.677245 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Role: member,reader Sep 01 14:13:14.677245 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Roles: member,reader Sep 01 14:13:14.678797 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/90a84500a899479aabfa3aeb72b4c4ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/90a84500a899479aabfa3aeb72b4c4ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/90a84500a899479aabfa3aeb72b4c4ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_90a84500a899479aabfa3aeb72b4c4ae"}]}] Sep 01 14:13:14.678797 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant: tempest-AttachVolumeNegativeTest-836381067 Sep 01 14:13:14.678797 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Id: 90a84500a899479aabfa3aeb72b4c4ae Sep 01 14:13:14.678797 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-836381067 Sep 01 14:13:14.678797 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User: tempest-AttachVolumeNegativeTest-836381067-project Sep 01 14:13:14.678797 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Id: default Sep 01 14:13:14.678797 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Name: Default Sep 01 14:13:14.678797 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Id: 7ae66df61a764a42a1b1b15f54d5c34b Sep 01 14:13:14.678797 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Name: tempest-AttachVolumeNegativeTest-836381067-project Sep 01 14:13:14.678797 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: method: > Sep 01 14:13:14.678797 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: exception: Instance 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce could not be found. Sep 01 14:13:14.678797 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: action_args: {'id': '7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce'} Sep 01 14:13:14.679550 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:13:14.679550 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:13:14.679550 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:13:14.679550 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:13:14.679550 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:13:14.679550 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:13:14.679550 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:13:14.679550 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:13:14.679550 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:13:14.679550 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:13:14.679550 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce could not be found. Sep 01 14:13:14.679550 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:13:14.679550 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:13:14.679550 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:13:14.679550 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:13:14.679550 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:13:14.679550 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:13:14.679550 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:13:14.679550 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:13:14.679550 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:13:14.680865 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:13:14.680865 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:13:14.680865 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:13:14.680865 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:13:14.680865 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:13:14.680865 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:13:14.680865 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:13:14.680865 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce could not be found. Sep 01 14:13:14.680865 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:13:14.680865 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:13:14.680865 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:13:14.680865 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:13:14.680865 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:13:14.680865 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:13:14.680865 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:13:14.680865 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:13:14.680865 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce could not be found. Sep 01 14:13:14.680865 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:13:14.683377 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-e1c080eb-d8e5-4af0-a344-8c897d2e87d4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Returning 404 to user: Instance 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce could not be found. {{(pid=121340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:13:14.686684 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-e1c080eb-d8e5-4af0-a344-8c897d2e87d4 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce" status: 404 len: 111 microversion: 2.1 time: 0.058429 Sep 01 14:13:14.687915 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 474/936] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:14 2022] GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:13:14.700350 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-e455110d-8f78-4d22-8c6e-4e59296ac8e0 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '.version_select at 0x7f9867804c10>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:14.882183 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-e455110d-8f78-4d22-8c6e-4e59296ac8e0 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1571845779" status: 202 len: 0 microversion: 2.1 time: 0.187154 Sep 01 14:13:14.887147 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 475/937] 10.222.0.25 () {58 vars in 1221 bytes} [Thu Sep 1 14:13:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1571845779 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:13:15.197310 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-4788b01b-55c1-47e1-80d4-21e112d79d0c tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1/os-volume_attachments/8a1be753-c2e7-470e-8afb-196ab28da723" status: 202 len: 0 microversion: 2.20 time: 1.138477 Sep 01 14:13:15.198733 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 463/938] 10.222.0.25 () {60 vars in 1457 bytes} [Thu Sep 1 14:13:14 2022] DELETE /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1/os-volume_attachments/8a1be753-c2e7-470e-8afb-196ab28da723 => generated 0 bytes in 1141 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:13:15.321611 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-4e154188-e015-44db-a28b-669d31ef3215 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:13:15.325099 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-4e154188-e015-44db-a28b-669d31ef3215 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:15.344529 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4e154188-e015-44db-a28b-669d31ef3215 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:15.346082 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4e154188-e015-44db-a28b-669d31ef3215 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:15.347201 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4e154188-e015-44db-a28b-669d31ef3215 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:15.350132 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4e154188-e015-44db-a28b-669d31ef3215 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:15.351681 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4e154188-e015-44db-a28b-669d31ef3215 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:15.355260 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4e154188-e015-44db-a28b-669d31ef3215 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:15.446888 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-4e154188-e015-44db-a28b-669d31ef3215 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121340) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 01 14:13:15.887282 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-4e154188-e015-44db-a28b-669d31ef3215 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "POST /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1/action" status: 202 len: 0 microversion: 2.20 time: 0.573684 Sep 01 14:13:15.892719 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 476/939] 10.222.0.25 () {62 vars in 1319 bytes} [Thu Sep 1 14:13:15 2022] POST /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1/action => generated 0 bytes in 580 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:13:15.898929 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-f48daf39-562a-42e3-a5d3-792713be67ba tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:15.899823 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-f48daf39-562a-42e3-a5d3-792713be67ba tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:15.908354 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f48daf39-562a-42e3-a5d3-792713be67ba tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:15.909115 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f48daf39-562a-42e3-a5d3-792713be67ba tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:15.909856 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f48daf39-562a-42e3-a5d3-792713be67ba tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:15.911068 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f48daf39-562a-42e3-a5d3-792713be67ba tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:15.915729 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f48daf39-562a-42e3-a5d3-792713be67ba tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:15.915729 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f48daf39-562a-42e3-a5d3-792713be67ba tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:16.031187 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-eabc8279-63f2-4432-b830-280b08b1fac1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:16.031964 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-eabc8279-63f2-4432-b830-280b08b1fac1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 8a8b6392-8237-47f3-9a9b-7a80f18f71c3] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:16.057192 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-eabc8279-63f2-4432-b830-280b08b1fac1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:16.058256 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-eabc8279-63f2-4432-b830-280b08b1fac1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:16.058882 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-eabc8279-63f2-4432-b830-280b08b1fac1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:16.061100 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-eabc8279-63f2-4432-b830-280b08b1fac1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:16.062214 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-eabc8279-63f2-4432-b830-280b08b1fac1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:16.063072 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-eabc8279-63f2-4432-b830-280b08b1fac1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:16.133422 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-eabc8279-63f2-4432-b830-280b08b1fac1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3/os-volume_attachments/2fc60575-8d2c-4176-801f-a3badc8fec00" status: 200 len: 194 microversion: 2.1 time: 0.107264 Sep 01 14:13:16.140745 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 477/940] 10.222.0.25 () {58 vars in 1413 bytes} [Thu Sep 1 14:13:16 2022] GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3/os-volume_attachments/2fc60575-8d2c-4176-801f-a3badc8fec00 => generated 194 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:13:16.154551 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-fe35a54c-f3af-42b6-8af3-66816420143e tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:16.160378 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-fe35a54c-f3af-42b6-8af3-66816420143e tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 8a8b6392-8237-47f3-9a9b-7a80f18f71c3] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:16.175000 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-fe35a54c-f3af-42b6-8af3-66816420143e tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:16.175964 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-fe35a54c-f3af-42b6-8af3-66816420143e tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:16.176848 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-fe35a54c-f3af-42b6-8af3-66816420143e tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:16.178314 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-fe35a54c-f3af-42b6-8af3-66816420143e tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:16.179268 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-fe35a54c-f3af-42b6-8af3-66816420143e tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:16.180167 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-fe35a54c-f3af-42b6-8af3-66816420143e tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:16.203174 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-f48daf39-562a-42e3-a5d3-792713be67ba tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:16.212994 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-f48daf39-562a-42e3-a5d3-792713be67ba tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:16.215047 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-f48daf39-562a-42e3-a5d3-792713be67ba tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:16.217206 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-f48daf39-562a-42e3-a5d3-792713be67ba tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1671 microversion: 2.20 time: 0.322611 Sep 01 14:13:16.218491 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 464/941] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:13:15 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1671 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:13:16.351298 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.objects.instance [None req-fe35a54c-f3af-42b6-8af3-66816420143e tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lazy-loading 'services' on Instance uuid 8a8b6392-8237-47f3-9a9b-7a80f18f71c3 {{(pid=121340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:13:16.563875 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-ebe8d6a8-0199-4f51-9121-1594233fb250 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Action: 'create', calling method: .version_select at 0x7f986b311ca0>, body: {"keypair": {"name": "tempest-keypair-397073497", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/Jx92P7zqbbJqwH8htyH/1QhC47ycYfdMCdJ2jZ1AXR+cmvFgDYFjdYzWZ3o0J2Fa/pbFT4ofOTLLeUcfuK06R+iJ5SEdlAQdt93LEAhgKZd8HIkPzJrmrY2YRjW/P5Q=="}} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:13:16.591917 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.quota [None req-ebe8d6a8-0199-4f51-9121-1594233fb250 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Getting quotas for project 90a84500a899479aabfa3aeb72b4c4ae. Resources: {'key_pairs'} {{(pid=121339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:13:16.602100 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.quota [None req-ebe8d6a8-0199-4f51-9121-1594233fb250 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Getting quotas for user 7ae66df61a764a42a1b1b15f54d5c34b and project 90a84500a899479aabfa3aeb72b4c4ae. Resources: {'key_pairs'} {{(pid=121339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:13:16.740921 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-ebe8d6a8-0199-4f51-9121-1594233fb250 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.184402 Sep 01 14:13:16.741735 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 465/942] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Sep 1 14:13:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:13:16.781590 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-fe35a54c-f3af-42b6-8af3-66816420143e tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3/os-volume_attachments/2fc60575-8d2c-4176-801f-a3badc8fec00" status: 202 len: 0 microversion: 2.1 time: 0.634187 Sep 01 14:13:16.782538 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 478/943] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Sep 1 14:13:16 2022] DELETE /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3/os-volume_attachments/2fc60575-8d2c-4176-801f-a3badc8fec00 => generated 0 bytes in 637 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:13:17.243937 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-b13455ad-e362-4ba0-a248-cdd44cfc65c9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:17.245131 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-b13455ad-e362-4ba0-a248-cdd44cfc65c9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:17.260190 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b13455ad-e362-4ba0-a248-cdd44cfc65c9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:17.260994 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b13455ad-e362-4ba0-a248-cdd44cfc65c9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:17.261733 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b13455ad-e362-4ba0-a248-cdd44cfc65c9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:17.262949 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b13455ad-e362-4ba0-a248-cdd44cfc65c9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:17.264469 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b13455ad-e362-4ba0-a248-cdd44cfc65c9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:17.265067 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b13455ad-e362-4ba0-a248-cdd44cfc65c9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:17.493180 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-b13455ad-e362-4ba0-a248-cdd44cfc65c9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:17.506801 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-b13455ad-e362-4ba0-a248-cdd44cfc65c9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:17.510778 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-b13455ad-e362-4ba0-a248-cdd44cfc65c9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:17.512471 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-b13455ad-e362-4ba0-a248-cdd44cfc65c9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1671 microversion: 2.20 time: 0.274979 Sep 01 14:13:17.542298 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 466/944] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:13:17 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1671 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:13:18.183954 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-d9370a57-e521-45c4-81ce-9dd7f66c95ea tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:18.189293 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-d9370a57-e521-45c4-81ce-9dd7f66c95ea tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 8a8b6392-8237-47f3-9a9b-7a80f18f71c3] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:18.200276 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:13:18.204011 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d9370a57-e521-45c4-81ce-9dd7f66c95ea tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:18.204885 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d9370a57-e521-45c4-81ce-9dd7f66c95ea tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:18.205573 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d9370a57-e521-45c4-81ce-9dd7f66c95ea tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:18.207037 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d9370a57-e521-45c4-81ce-9dd7f66c95ea tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:18.207653 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d9370a57-e521-45c4-81ce-9dd7f66c95ea tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:18.208211 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d9370a57-e521-45c4-81ce-9dd7f66c95ea tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:18.253090 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-d9370a57-e521-45c4-81ce-9dd7f66c95ea tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.082000 Sep 01 14:13:18.253935 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 479/945] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 14:13:18 2022] GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3/os-volume_attachments => generated 25 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 14:13:18.424582 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-c193a39a-c1f1-4200-9fbd-d49a50d3d749 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:18.426959 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-c193a39a-c1f1-4200-9fbd-d49a50d3d749 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 8a8b6392-8237-47f3-9a9b-7a80f18f71c3] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:18.433890 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c193a39a-c1f1-4200-9fbd-d49a50d3d749 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:18.434590 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c193a39a-c1f1-4200-9fbd-d49a50d3d749 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:18.435041 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c193a39a-c1f1-4200-9fbd-d49a50d3d749 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:18.436425 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c193a39a-c1f1-4200-9fbd-d49a50d3d749 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:18.436901 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c193a39a-c1f1-4200-9fbd-d49a50d3d749 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:18.441007 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c193a39a-c1f1-4200-9fbd-d49a50d3d749 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:18.484316 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-c193a39a-c1f1-4200-9fbd-d49a50d3d749 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063819 Sep 01 14:13:18.485514 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 467/946] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 14:13:18 2022] GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 14:13:18.571188 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-71b4948d-6d9a-4fc1-ba6d-ff4b07b24432 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:18.571188 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-71b4948d-6d9a-4fc1-ba6d-ff4b07b24432 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:18.590404 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-d554303b-e712-4e01-aa5d-b602ad1183e0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:18.590404 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-d554303b-e712-4e01-aa5d-b602ad1183e0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 8a8b6392-8237-47f3-9a9b-7a80f18f71c3] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:18.592676 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d554303b-e712-4e01-aa5d-b602ad1183e0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:18.593417 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d554303b-e712-4e01-aa5d-b602ad1183e0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:18.594126 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d554303b-e712-4e01-aa5d-b602ad1183e0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:18.595218 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d554303b-e712-4e01-aa5d-b602ad1183e0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:18.595933 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d554303b-e712-4e01-aa5d-b602ad1183e0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:18.596487 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-71b4948d-6d9a-4fc1-ba6d-ff4b07b24432 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:18.596976 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d554303b-e712-4e01-aa5d-b602ad1183e0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:18.597254 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-71b4948d-6d9a-4fc1-ba6d-ff4b07b24432 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:18.597987 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-71b4948d-6d9a-4fc1-ba6d-ff4b07b24432 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:18.599114 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-71b4948d-6d9a-4fc1-ba6d-ff4b07b24432 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:18.599911 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-71b4948d-6d9a-4fc1-ba6d-ff4b07b24432 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:18.600571 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-71b4948d-6d9a-4fc1-ba6d-ff4b07b24432 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:18.675979 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-d554303b-e712-4e01-aa5d-b602ad1183e0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 8a8b6392-8237-47f3-9a9b-7a80f18f71c3] Going to try to terminate instance {{(pid=121339) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:13:18.858578 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=5 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:13:18.995779 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-71b4948d-6d9a-4fc1-ba6d-ff4b07b24432 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:19.007139 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-71b4948d-6d9a-4fc1-ba6d-ff4b07b24432 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:19.008967 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-71b4948d-6d9a-4fc1-ba6d-ff4b07b24432 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:19.010388 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-71b4948d-6d9a-4fc1-ba6d-ff4b07b24432 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1671 microversion: 2.20 time: 0.451536 Sep 01 14:13:19.011113 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 480/947] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:13:18 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1671 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:13:19.071186 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-d554303b-e712-4e01-aa5d-b602ad1183e0 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3" status: 204 len: 0 microversion: 2.1 time: 0.491843 Sep 01 14:13:19.072305 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 468/948] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 14:13:18 2022] DELETE /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 14:13:19.082386 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-b7b8eb18-92c9-46e0-91e5-bc52f837b65c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:19.083036 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-b7b8eb18-92c9-46e0-91e5-bc52f837b65c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 8a8b6392-8237-47f3-9a9b-7a80f18f71c3] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:19.089558 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b7b8eb18-92c9-46e0-91e5-bc52f837b65c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:19.090066 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b7b8eb18-92c9-46e0-91e5-bc52f837b65c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:19.090719 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b7b8eb18-92c9-46e0-91e5-bc52f837b65c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:19.091446 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b7b8eb18-92c9-46e0-91e5-bc52f837b65c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:19.092652 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b7b8eb18-92c9-46e0-91e5-bc52f837b65c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:19.093160 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b7b8eb18-92c9-46e0-91e5-bc52f837b65c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:19.296394 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-b7b8eb18-92c9-46e0-91e5-bc52f837b65c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:19.305344 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-b7b8eb18-92c9-46e0-91e5-bc52f837b65c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3" status: 200 len: 1672 microversion: 2.1 time: 0.227162 Sep 01 14:13:19.306524 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 481/949] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:19 2022] GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3 => generated 1672 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:20.044227 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-e52a182e-1b27-423f-8c38-71dc834f19a7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:20.045228 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-e52a182e-1b27-423f-8c38-71dc834f19a7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:20.053889 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e52a182e-1b27-423f-8c38-71dc834f19a7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:20.054432 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e52a182e-1b27-423f-8c38-71dc834f19a7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:20.055047 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e52a182e-1b27-423f-8c38-71dc834f19a7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:20.055703 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e52a182e-1b27-423f-8c38-71dc834f19a7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:20.056164 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e52a182e-1b27-423f-8c38-71dc834f19a7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:20.056592 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e52a182e-1b27-423f-8c38-71dc834f19a7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:20.279268 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-e52a182e-1b27-423f-8c38-71dc834f19a7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:20.288580 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-e52a182e-1b27-423f-8c38-71dc834f19a7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:20.290092 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-e52a182e-1b27-423f-8c38-71dc834f19a7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:20.291382 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-e52a182e-1b27-423f-8c38-71dc834f19a7 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1673 microversion: 2.20 time: 0.252124 Sep 01 14:13:20.291930 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 469/950] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:13:20 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1673 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:13:20.327631 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-3d72bf2f-813f-438b-ac4b-9a422041a4c5 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:20.328481 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-3d72bf2f-813f-438b-ac4b-9a422041a4c5 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 8a8b6392-8237-47f3-9a9b-7a80f18f71c3] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:20.335763 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3d72bf2f-813f-438b-ac4b-9a422041a4c5 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:20.336143 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3d72bf2f-813f-438b-ac4b-9a422041a4c5 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:20.336571 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3d72bf2f-813f-438b-ac4b-9a422041a4c5 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:20.337286 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3d72bf2f-813f-438b-ac4b-9a422041a4c5 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:20.337744 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3d72bf2f-813f-438b-ac4b-9a422041a4c5 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:20.338230 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3d72bf2f-813f-438b-ac4b-9a422041a4c5 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:20.491468 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-3d72bf2f-813f-438b-ac4b-9a422041a4c5 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:20.499659 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-26816255-67d4-4b1c-a55b-9531734a3b93 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1778776563", "imageRef": "9be77128-e763-4225-b76f-85fbb04ad9b2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4f2459fa-f112-4ee1-abd3-6f4952507858"}], "security_groups": [{"name": "tempest-securitygroup--780066991"}], "key_name": "tempest-keypair-397073497", "user_data": "}} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:13:20.501341 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-3d72bf2f-813f-438b-ac4b-9a422041a4c5 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3" status: 200 len: 1672 microversion: 2.1 time: 0.178061 Sep 01 14:13:20.502380 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 482/951] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:20 2022] GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3 => generated 1672 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:20.637519 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.network.neutron [None req-26816255-67d4-4b1c-a55b-9531734a3b93 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] validate_networks() for [('4f2459fa-f112-4ee1-abd3-6f4952507858', None, None, None, None, None)] {{(pid=121339) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:13:21.005038 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-6ef322fe-2b49-4f42-a6ae-9448d13f2c53 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1198888746", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1695617707", "security_groups": [{"name": "tempest-secgroup-smoke-597656021"}], "block_device_mapping_v2": [{"uuid": "2fee184e-c65e-4451-9214-86803be02b83", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ebd60ad1-5f3d-4543-91a0-ad7aa3eae6b0"}]}} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:13:21.318691 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.network.neutron [None req-6ef322fe-2b49-4f42-a6ae-9448d13f2c53 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] validate_networks() for [('ebd60ad1-5f3d-4543-91a0-ad7aa3eae6b0', None, None, None, None, None)] {{(pid=121340) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:13:21.368937 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.virt.hardware [None req-26816255-67d4-4b1c-a55b-9531734a3b93 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Flavor limits 0:0:0 {{(pid=121339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:13:21.369853 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.virt.hardware [None req-26816255-67d4-4b1c-a55b-9531734a3b93 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Image limits 0:0:0 {{(pid=121339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:13:21.371119 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.virt.hardware [None req-26816255-67d4-4b1c-a55b-9531734a3b93 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Flavor pref 0:0:0 {{(pid=121339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:13:21.372297 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.virt.hardware [None req-26816255-67d4-4b1c-a55b-9531734a3b93 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Image pref 0:0:0 {{(pid=121339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:13:21.374579 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.virt.hardware [None req-26816255-67d4-4b1c-a55b-9531734a3b93 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121339) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:13:21.390057 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-26816255-67d4-4b1c-a55b-9531734a3b93 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:21.391845 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-26816255-67d4-4b1c-a55b-9531734a3b93 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:21.395187 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-26816255-67d4-4b1c-a55b-9531734a3b93 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:21.397226 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-26816255-67d4-4b1c-a55b-9531734a3b93 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:21.399794 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-26816255-67d4-4b1c-a55b-9531734a3b93 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:21.401038 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-26816255-67d4-4b1c-a55b-9531734a3b93 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:21.430598 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.quota [None req-26816255-67d4-4b1c-a55b-9531734a3b93 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Getting quotas for project 90a84500a899479aabfa3aeb72b4c4ae. Resources: {'cores', 'instances', 'ram'} {{(pid=121339) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:13:21.436627 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.quota [None req-26816255-67d4-4b1c-a55b-9531734a3b93 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Getting quotas for user 7ae66df61a764a42a1b1b15f54d5c34b and project 90a84500a899479aabfa3aeb72b4c4ae. Resources: {'cores', 'instances', 'ram'} {{(pid=121339) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:13:21.450851 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-26816255-67d4-4b1c-a55b-9531734a3b93 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Going to run 1 instances... {{(pid=121339) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:13:21.454577 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-26816255-67d4-4b1c-a55b-9531734a3b93 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: f21e2730-924a-436f-a04b-ce7bc9b47ea9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9be77128-e763-4225-b76f-85fbb04ad9b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121339) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:13:21.771610 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-26816255-67d4-4b1c-a55b-9531734a3b93 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.278240 Sep 01 14:13:21.772468 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 470/952] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 1 14:13:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 1281 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 14:13:21.795965 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-c7f2a0a8-b5e2-459c-b3f8-faad39967410 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:21.797268 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-c7f2a0a8-b5e2-459c-b3f8-faad39967410 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:21.821493 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c7f2a0a8-b5e2-459c-b3f8-faad39967410 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:21.822407 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c7f2a0a8-b5e2-459c-b3f8-faad39967410 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:21.823799 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c7f2a0a8-b5e2-459c-b3f8-faad39967410 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:21.825435 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c7f2a0a8-b5e2-459c-b3f8-faad39967410 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:21.827296 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c7f2a0a8-b5e2-459c-b3f8-faad39967410 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:21.848120 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c7f2a0a8-b5e2-459c-b3f8-faad39967410 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:22.558461 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-6ef322fe-2b49-4f42-a6ae-9448d13f2c53 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Flavor limits 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:13:22.560339 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-6ef322fe-2b49-4f42-a6ae-9448d13f2c53 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Image limits 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:13:22.561697 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-6ef322fe-2b49-4f42-a6ae-9448d13f2c53 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Flavor pref 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:13:22.562915 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-6ef322fe-2b49-4f42-a6ae-9448d13f2c53 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Image pref 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:13:22.565188 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-6ef322fe-2b49-4f42-a6ae-9448d13f2c53 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:13:22.592949 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6ef322fe-2b49-4f42-a6ae-9448d13f2c53 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:22.596707 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6ef322fe-2b49-4f42-a6ae-9448d13f2c53 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:22.599164 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6ef322fe-2b49-4f42-a6ae-9448d13f2c53 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:22.605276 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6ef322fe-2b49-4f42-a6ae-9448d13f2c53 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:22.608548 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6ef322fe-2b49-4f42-a6ae-9448d13f2c53 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:22.610970 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6ef322fe-2b49-4f42-a6ae-9448d13f2c53 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:22.644951 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-c7f2a0a8-b5e2-459c-b3f8-faad39967410 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:22.661038 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.quota [None req-6ef322fe-2b49-4f42-a6ae-9448d13f2c53 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Getting quotas for project 8acdb976501045c0813d16f3d0ffd13d. Resources: {'cores', 'instances', 'ram'} {{(pid=121340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:13:22.673452 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-c7f2a0a8-b5e2-459c-b3f8-faad39967410 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:22.677625 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-c7f2a0a8-b5e2-459c-b3f8-faad39967410 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:22.687315 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.quota [None req-6ef322fe-2b49-4f42-a6ae-9448d13f2c53 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Getting quotas for user 93f843d15d194f0b9f44ec33c49b9b4c and project 8acdb976501045c0813d16f3d0ffd13d. Resources: {'cores', 'instances', 'ram'} {{(pid=121340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:13:22.692680 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-c7f2a0a8-b5e2-459c-b3f8-faad39967410 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1729 microversion: 2.20 time: 0.913449 Sep 01 14:13:22.694148 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 471/953] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:13:21 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1729 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:13:22.704327 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-e696c058-a31b-45fb-a1cb-07e5bcd2e7c1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:22.705462 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-e696c058-a31b-45fb-a1cb-07e5bcd2e7c1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 8a8b6392-8237-47f3-9a9b-7a80f18f71c3] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:22.725694 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e696c058-a31b-45fb-a1cb-07e5bcd2e7c1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:22.729065 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e696c058-a31b-45fb-a1cb-07e5bcd2e7c1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:22.734756 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e696c058-a31b-45fb-a1cb-07e5bcd2e7c1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:22.736523 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e696c058-a31b-45fb-a1cb-07e5bcd2e7c1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:22.737562 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e696c058-a31b-45fb-a1cb-07e5bcd2e7c1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:22.738380 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e696c058-a31b-45fb-a1cb-07e5bcd2e7c1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:22.829938 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-6ef322fe-2b49-4f42-a6ae-9448d13f2c53 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Going to run 1 instances... {{(pid=121340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:13:22.833170 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-6ef322fe-2b49-4f42-a6ae-9448d13f2c53 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: e221a685-4333-48cb-ab94-67a4c0402490] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2fee184e-c65e-4451-9214-86803be02b83',volume_size=None,volume_type=None)] {{(pid=121340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:13:22.973171 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-e696c058-a31b-45fb-a1cb-07e5bcd2e7c1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:22.993744 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-e696c058-a31b-45fb-a1cb-07e5bcd2e7c1 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3" status: 200 len: 1604 microversion: 2.1 time: 0.297960 Sep 01 14:13:23.011031 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 472/954] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:22 2022] GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3 => generated 1604 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:23.031222 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-aa8b770e-e103-4a6e-b2d5-0cb8e01cf05f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:23.032199 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-aa8b770e-e103-4a6e-b2d5-0cb8e01cf05f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: f21e2730-924a-436f-a04b-ce7bc9b47ea9] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:23.105080 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-aa8b770e-e103-4a6e-b2d5-0cb8e01cf05f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:23.113810 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-aa8b770e-e103-4a6e-b2d5-0cb8e01cf05f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9" status: 200 len: 1241 microversion: 2.1 time: 0.101103 Sep 01 14:13:23.114948 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 473/955] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:23 2022] GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9 => generated 1241 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:23.133541 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [req-fd117d8a-37ee-45ae-b881-981bc086ab91 req-a75df9c6-7554-4640-8ce9-c48723e5e1c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a8b6392-8237-47f3-9a9b-7a80f18f71c3", "name": "network-vif-deleted", "tag": "8eaab8ca-5a28-4ca2-ab32-f0a1392d34b7"}]} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:13:23.178459 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-fd117d8a-37ee-45ae-b881-981bc086ab91 req-a75df9c6-7554-4640-8ce9-c48723e5e1c9 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:23.178459 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-fd117d8a-37ee-45ae-b881-981bc086ab91 req-a75df9c6-7554-4640-8ce9-c48723e5e1c9 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:23.181716 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-fd117d8a-37ee-45ae-b881-981bc086ab91 req-a75df9c6-7554-4640-8ce9-c48723e5e1c9 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:23.228320 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.compute.server_external_events [req-fd117d8a-37ee-45ae-b881-981bc086ab91 req-a75df9c6-7554-4640-8ce9-c48723e5e1c9 service nova] Creating event network-vif-deleted:8eaab8ca-5a28-4ca2-ab32-f0a1392d34b7 for instance 8a8b6392-8237-47f3-9a9b-7a80f18f71c3 on hv-cinder-85221 Sep 01 14:13:23.241328 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [req-fd117d8a-37ee-45ae-b881-981bc086ab91 req-a75df9c6-7554-4640-8ce9-c48723e5e1c9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113365 Sep 01 14:13:23.242804 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 474/956] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:13:23.518232 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-6ef322fe-2b49-4f42-a6ae-9448d13f2c53 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.521420 Sep 01 14:13:23.519408 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 483/957] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 1 14:13:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 2524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 14:13:23.537401 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-f2ef77eb-8908-4a57-8910-6553cd6e9f38 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:23.549771 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-f2ef77eb-8908-4a57-8910-6553cd6e9f38 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: e221a685-4333-48cb-ab94-67a4c0402490] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:23.615429 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-f2ef77eb-8908-4a57-8910-6553cd6e9f38 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:23.635279 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-f2ef77eb-8908-4a57-8910-6553cd6e9f38 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490" status: 200 len: 1095 microversion: 2.1 time: 0.107436 Sep 01 14:13:23.636261 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 475/958] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:23 2022] GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490 => generated 1095 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:23.731768 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-9c56c1ff-86a3-424f-81ba-d815dd277dc0 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:23.734705 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-9c56c1ff-86a3-424f-81ba-d815dd277dc0 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:23.742239 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9c56c1ff-86a3-424f-81ba-d815dd277dc0 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:23.742976 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9c56c1ff-86a3-424f-81ba-d815dd277dc0 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:23.744221 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9c56c1ff-86a3-424f-81ba-d815dd277dc0 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:23.745109 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9c56c1ff-86a3-424f-81ba-d815dd277dc0 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:23.745756 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9c56c1ff-86a3-424f-81ba-d815dd277dc0 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:23.746668 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9c56c1ff-86a3-424f-81ba-d815dd277dc0 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:23.756465 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=6,nova_cell1:UPDATE=5 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:13:24.039419 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-fe8ed6eb-9527-411e-a087-006bee96521b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:24.040204 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-fe8ed6eb-9527-411e-a087-006bee96521b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 8a8b6392-8237-47f3-9a9b-7a80f18f71c3] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:24.047957 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fe8ed6eb-9527-411e-a087-006bee96521b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:24.048614 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fe8ed6eb-9527-411e-a087-006bee96521b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:24.049182 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fe8ed6eb-9527-411e-a087-006bee96521b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:24.050761 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fe8ed6eb-9527-411e-a087-006bee96521b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:24.051405 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fe8ed6eb-9527-411e-a087-006bee96521b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:24.051942 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fe8ed6eb-9527-411e-a087-006bee96521b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:24.092482 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fe8ed6eb-9527-411e-a087-006bee96521b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:24.093398 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fe8ed6eb-9527-411e-a087-006bee96521b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:24.093851 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fe8ed6eb-9527-411e-a087-006bee96521b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:24.094396 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.objects.instance [None req-fe8ed6eb-9527-411e-a087-006bee96521b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lazy-loading 'fault' on Instance uuid 8a8b6392-8237-47f3-9a9b-7a80f18f71c3 {{(pid=121339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:13:24.209053 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-fe8ed6eb-9527-411e-a087-006bee96521b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff664c7ba095413daad6b3f1ebc49cc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaba67e3a54f4191b9b924305a83e4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:24.222930 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-fe8ed6eb-9527-411e-a087-006bee96521b tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3" status: 200 len: 1326 microversion: 2.1 time: 0.192816 Sep 01 14:13:24.227497 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 476/959] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:24 2022] GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3 => generated 1326 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:13:24.233798 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-dd456ce6-1837-493e-81ca-e41e8182af75 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:24.241744 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-dd456ce6-1837-493e-81ca-e41e8182af75 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: f21e2730-924a-436f-a04b-ce7bc9b47ea9] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:24.260145 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-dd456ce6-1837-493e-81ca-e41e8182af75 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:24.260661 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-dd456ce6-1837-493e-81ca-e41e8182af75 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:24.265414 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-dd456ce6-1837-493e-81ca-e41e8182af75 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:24.266374 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-dd456ce6-1837-493e-81ca-e41e8182af75 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:24.266866 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-dd456ce6-1837-493e-81ca-e41e8182af75 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:24.267309 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-dd456ce6-1837-493e-81ca-e41e8182af75 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:24.300519 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-9c56c1ff-86a3-424f-81ba-d815dd277dc0 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:24.313599 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-9c56c1ff-86a3-424f-81ba-d815dd277dc0 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:24.316254 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-9c56c1ff-86a3-424f-81ba-d815dd277dc0 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:24.318101 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-9c56c1ff-86a3-424f-81ba-d815dd277dc0 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1729 microversion: 2.20 time: 0.601872 Sep 01 14:13:24.319668 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 484/960] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:13:23 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1729 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:13:24.374520 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-dd456ce6-1837-493e-81ca-e41e8182af75 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:24.386674 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-dd456ce6-1837-493e-81ca-e41e8182af75 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9" status: 200 len: 1237 microversion: 2.1 time: 0.156464 Sep 01 14:13:24.388781 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 477/961] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:24 2022] GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9 => generated 1237 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:24.665745 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-a0d352ef-b468-4ef2-8cd7-fd252d8967ec tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:24.666449 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-a0d352ef-b468-4ef2-8cd7-fd252d8967ec tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: e221a685-4333-48cb-ab94-67a4c0402490] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:24.762018 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-a0d352ef-b468-4ef2-8cd7-fd252d8967ec tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:24.778342 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-a0d352ef-b468-4ef2-8cd7-fd252d8967ec tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490" status: 200 len: 1095 microversion: 2.1 time: 0.117078 Sep 01 14:13:24.790493 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 485/962] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:24 2022] GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490 => generated 1095 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:25.271468 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-4b4679d8-b526-4278-80b8-91d3843626ff tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:25.272452 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-4b4679d8-b526-4278-80b8-91d3843626ff tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 8a8b6392-8237-47f3-9a9b-7a80f18f71c3] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:25.281400 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4b4679d8-b526-4278-80b8-91d3843626ff tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:25.282234 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4b4679d8-b526-4278-80b8-91d3843626ff tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:25.282869 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4b4679d8-b526-4278-80b8-91d3843626ff tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:25.283970 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4b4679d8-b526-4278-80b8-91d3843626ff tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:25.284465 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4b4679d8-b526-4278-80b8-91d3843626ff tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:25.285101 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4b4679d8-b526-4278-80b8-91d3843626ff tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:25.323148 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.wsgi [None req-4b4679d8-b526-4278-80b8-91d3843626ff tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] HTTP exception thrown: Instance 8a8b6392-8237-47f3-9a9b-7a80f18f71c3 could not be found. Sep 01 14:13:25.327374 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-4b4679d8-b526-4278-80b8-91d3843626ff tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Request method failure captured: Sep 01 14:13:25.327374 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: request: GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3 HTTP/1.1 Sep 01 14:13:25.327374 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept: application/json Sep 01 14:13:25.327374 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept-Encoding: identity Sep 01 14:13:25.327374 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Connection: close Sep 01 14:13:25.327374 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Length: 0 Sep 01 14:13:25.327374 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Type: application/json Sep 01 14:13:25.327374 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Host: 10.222.0.25 Sep 01 14:13:25.327374 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Openstack-System-Scope: None Sep 01 14:13:25.327374 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: User-Agent: python-urllib3/1.26.12 Sep 01 14:13:25.327374 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Auth-Token: gAAAAABjELxJFCqHL6iDW93p2fAK82qpj7L1D7D7ilryiMV3DyGHDC5twKjpobCzpdbmKrw1i62S3hizpMOIs5ob_AyQm5W6dnNLK6OpjiuLVoCJElwf7M_K99jJdNFPOzu8jRRuhJkpEHOKHKZFt9UvUOXe97P6WYXoFXwhzBcefsvHS2el000 Sep 01 14:13:25.327374 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Id: None Sep 01 14:13:25.327374 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Name: None Sep 01 14:13:25.327374 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Identity-Status: Confirmed Sep 01 14:13:25.327374 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Is-Admin-Project: True Sep 01 14:13:25.327374 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Id: default Sep 01 14:13:25.327374 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Name: Default Sep 01 14:13:25.327374 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Id: eaba67e3a54f4191b9b924305a83e4eb Sep 01 14:13:25.327374 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Name: tempest-AttachVolumeTestJSON-224345679 Sep 01 14:13:25.327374 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Role: member,reader Sep 01 14:13:25.327374 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Roles: member,reader Sep 01 14:13:25.329480 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaba67e3a54f4191b9b924305a83e4eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eaba67e3a54f4191b9b924305a83e4eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaba67e3a54f4191b9b924305a83e4eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eaba67e3a54f4191b9b924305a83e4eb"}]}] Sep 01 14:13:25.329480 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant: tempest-AttachVolumeTestJSON-224345679 Sep 01 14:13:25.329480 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Id: eaba67e3a54f4191b9b924305a83e4eb Sep 01 14:13:25.329480 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Name: tempest-AttachVolumeTestJSON-224345679 Sep 01 14:13:25.329480 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User: tempest-AttachVolumeTestJSON-224345679-project Sep 01 14:13:25.329480 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Id: default Sep 01 14:13:25.329480 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Name: Default Sep 01 14:13:25.329480 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Id: ff664c7ba095413daad6b3f1ebc49cc0 Sep 01 14:13:25.329480 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Name: tempest-AttachVolumeTestJSON-224345679-project Sep 01 14:13:25.329480 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: method: > Sep 01 14:13:25.329480 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: exception: Instance 8a8b6392-8237-47f3-9a9b-7a80f18f71c3 could not be found. Sep 01 14:13:25.329480 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: action_args: {'id': '8a8b6392-8237-47f3-9a9b-7a80f18f71c3'} Sep 01 14:13:25.330454 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:13:25.330454 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:13:25.330454 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:13:25.330454 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:13:25.330454 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:13:25.330454 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:13:25.330454 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:13:25.330454 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:13:25.330454 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:13:25.330454 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:13:25.330454 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a8b6392-8237-47f3-9a9b-7a80f18f71c3 could not be found. Sep 01 14:13:25.330454 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:13:25.330454 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:13:25.330454 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:13:25.330454 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:13:25.330454 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:13:25.330454 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:13:25.330454 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:13:25.330454 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:13:25.330454 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:13:25.332349 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:13:25.332349 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:13:25.332349 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:13:25.332349 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:13:25.332349 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:13:25.332349 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:13:25.332349 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:13:25.332349 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a8b6392-8237-47f3-9a9b-7a80f18f71c3 could not be found. Sep 01 14:13:25.332349 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:13:25.332349 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:13:25.332349 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:13:25.332349 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:13:25.332349 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:13:25.332349 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:13:25.332349 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:13:25.332349 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:13:25.332349 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a8b6392-8237-47f3-9a9b-7a80f18f71c3 could not be found. Sep 01 14:13:25.332349 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:13:25.335149 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-4b4679d8-b526-4278-80b8-91d3843626ff tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Returning 404 to user: Instance 8a8b6392-8237-47f3-9a9b-7a80f18f71c3 could not be found. {{(pid=121339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:13:25.336624 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-4b4679d8-b526-4278-80b8-91d3843626ff tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3" status: 404 len: 111 microversion: 2.1 time: 0.069252 Sep 01 14:13:25.337526 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 478/963] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:25 2022] GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:13:25.353107 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-9ea569f9-5b5b-4314-9345-6601e53e265e tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '.version_select at 0x7f9867abc9d0>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:25.374298 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-efb413fa-9153-42d6-982e-e41c38bfe5ec tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:25.375577 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-efb413fa-9153-42d6-982e-e41c38bfe5ec tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:25.390129 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-efb413fa-9153-42d6-982e-e41c38bfe5ec tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:25.391497 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-efb413fa-9153-42d6-982e-e41c38bfe5ec tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:25.392630 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-efb413fa-9153-42d6-982e-e41c38bfe5ec tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:25.394265 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-efb413fa-9153-42d6-982e-e41c38bfe5ec tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:25.395166 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-efb413fa-9153-42d6-982e-e41c38bfe5ec tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:25.395960 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-efb413fa-9153-42d6-982e-e41c38bfe5ec tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:25.465457 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-9ea569f9-5b5b-4314-9345-6601e53e265e tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-610374008" status: 202 len: 0 microversion: 2.1 time: 0.120869 Sep 01 14:13:25.471469 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 479/964] 10.222.0.25 () {58 vars in 1218 bytes} [Thu Sep 1 14:13:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-610374008 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:13:25.476225 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-e7cc93f4-bf0f-4694-a3ac-968afe979f1d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:25.477178 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-e7cc93f4-bf0f-4694-a3ac-968afe979f1d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: f21e2730-924a-436f-a04b-ce7bc9b47ea9] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:25.485387 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e7cc93f4-bf0f-4694-a3ac-968afe979f1d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:25.486275 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e7cc93f4-bf0f-4694-a3ac-968afe979f1d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:25.486945 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e7cc93f4-bf0f-4694-a3ac-968afe979f1d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:25.487872 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e7cc93f4-bf0f-4694-a3ac-968afe979f1d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:25.488511 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e7cc93f4-bf0f-4694-a3ac-968afe979f1d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:25.489110 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e7cc93f4-bf0f-4694-a3ac-968afe979f1d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:25.635311 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-e7cc93f4-bf0f-4694-a3ac-968afe979f1d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:25.648499 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-e7cc93f4-bf0f-4694-a3ac-968afe979f1d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9" status: 200 len: 1293 microversion: 2.1 time: 0.176008 Sep 01 14:13:25.649576 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 480/965] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:25 2022] GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9 => generated 1293 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:25.685242 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-efb413fa-9153-42d6-982e-e41c38bfe5ec tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:25.702162 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-efb413fa-9153-42d6-982e-e41c38bfe5ec tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:25.706208 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-efb413fa-9153-42d6-982e-e41c38bfe5ec tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:25.709333 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-efb413fa-9153-42d6-982e-e41c38bfe5ec tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1729 microversion: 2.20 time: 0.342881 Sep 01 14:13:25.711166 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 486/966] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:13:25 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1729 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:13:25.804042 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-5e4c23f5-e28d-4802-b776-1633757eff58 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:25.809537 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-5e4c23f5-e28d-4802-b776-1633757eff58 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: e221a685-4333-48cb-ab94-67a4c0402490] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:25.818477 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5e4c23f5-e28d-4802-b776-1633757eff58 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:25.819805 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5e4c23f5-e28d-4802-b776-1633757eff58 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:25.821170 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5e4c23f5-e28d-4802-b776-1633757eff58 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:25.822831 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5e4c23f5-e28d-4802-b776-1633757eff58 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:25.823973 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5e4c23f5-e28d-4802-b776-1633757eff58 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:25.824972 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5e4c23f5-e28d-4802-b776-1633757eff58 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:25.944596 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-5e4c23f5-e28d-4802-b776-1633757eff58 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:25.964989 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-5e4c23f5-e28d-4802-b776-1633757eff58 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490" status: 200 len: 1145 microversion: 2.1 time: 0.167312 Sep 01 14:13:25.983796 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 481/967] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:25 2022] GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490 => generated 1145 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:26.672896 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-09e411c3-a26c-4b00-9dc2-85b91c4e380d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:26.673782 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-09e411c3-a26c-4b00-9dc2-85b91c4e380d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: f21e2730-924a-436f-a04b-ce7bc9b47ea9] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:26.682351 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-09e411c3-a26c-4b00-9dc2-85b91c4e380d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:26.684154 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-09e411c3-a26c-4b00-9dc2-85b91c4e380d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:26.684154 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-09e411c3-a26c-4b00-9dc2-85b91c4e380d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:26.686186 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-09e411c3-a26c-4b00-9dc2-85b91c4e380d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:26.687869 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-09e411c3-a26c-4b00-9dc2-85b91c4e380d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:26.689106 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-09e411c3-a26c-4b00-9dc2-85b91c4e380d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:26.745194 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-7eebb95e-fd2b-49b0-9c08-96101fcec4fd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:26.746626 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-7eebb95e-fd2b-49b0-9c08-96101fcec4fd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:26.756589 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7eebb95e-fd2b-49b0-9c08-96101fcec4fd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:26.757240 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7eebb95e-fd2b-49b0-9c08-96101fcec4fd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:26.757795 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7eebb95e-fd2b-49b0-9c08-96101fcec4fd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:26.758908 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7eebb95e-fd2b-49b0-9c08-96101fcec4fd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:26.759517 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7eebb95e-fd2b-49b0-9c08-96101fcec4fd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:26.760265 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7eebb95e-fd2b-49b0-9c08-96101fcec4fd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:26.842302 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-09e411c3-a26c-4b00-9dc2-85b91c4e380d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:26.855099 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-09e411c3-a26c-4b00-9dc2-85b91c4e380d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9" status: 200 len: 1293 microversion: 2.1 time: 0.187451 Sep 01 14:13:26.856021 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 487/968] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:26 2022] GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9 => generated 1293 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:27.006923 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-e57fc2b8-a44e-4b09-b0ca-772c1fe9e2ca tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:27.007578 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-e57fc2b8-a44e-4b09-b0ca-772c1fe9e2ca tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: e221a685-4333-48cb-ab94-67a4c0402490] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:27.020528 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e57fc2b8-a44e-4b09-b0ca-772c1fe9e2ca tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:27.021666 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e57fc2b8-a44e-4b09-b0ca-772c1fe9e2ca tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:27.027323 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e57fc2b8-a44e-4b09-b0ca-772c1fe9e2ca tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:27.028265 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e57fc2b8-a44e-4b09-b0ca-772c1fe9e2ca tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:27.029020 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e57fc2b8-a44e-4b09-b0ca-772c1fe9e2ca tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:27.030123 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e57fc2b8-a44e-4b09-b0ca-772c1fe9e2ca tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:27.072653 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-7eebb95e-fd2b-49b0-9c08-96101fcec4fd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:27.082707 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-7eebb95e-fd2b-49b0-9c08-96101fcec4fd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:27.084215 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-7eebb95e-fd2b-49b0-9c08-96101fcec4fd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:27.085470 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-7eebb95e-fd2b-49b0-9c08-96101fcec4fd tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1729 microversion: 2.20 time: 0.344642 Sep 01 14:13:27.086122 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 482/969] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:13:26 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1729 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:13:27.157216 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-e57fc2b8-a44e-4b09-b0ca-772c1fe9e2ca tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:27.167100 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-e57fc2b8-a44e-4b09-b0ca-772c1fe9e2ca tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490" status: 200 len: 1145 microversion: 2.1 time: 0.175031 Sep 01 14:13:27.169960 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 488/970] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:26 2022] GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490 => generated 1145 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:27.882357 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-e94efc93-8e64-4499-9465-3c8b1de8b9cc tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:27.884441 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-e94efc93-8e64-4499-9465-3c8b1de8b9cc tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: f21e2730-924a-436f-a04b-ce7bc9b47ea9] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:27.896655 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e94efc93-8e64-4499-9465-3c8b1de8b9cc tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:27.897485 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e94efc93-8e64-4499-9465-3c8b1de8b9cc tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:27.898006 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e94efc93-8e64-4499-9465-3c8b1de8b9cc tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:27.898950 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e94efc93-8e64-4499-9465-3c8b1de8b9cc tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:27.899617 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e94efc93-8e64-4499-9465-3c8b1de8b9cc tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:27.900075 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e94efc93-8e64-4499-9465-3c8b1de8b9cc tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:27.998460 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-e94efc93-8e64-4499-9465-3c8b1de8b9cc tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:28.014338 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-e94efc93-8e64-4499-9465-3c8b1de8b9cc tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9" status: 200 len: 1293 microversion: 2.1 time: 0.137818 Sep 01 14:13:28.026000 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 483/971] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:27 2022] GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9 => generated 1293 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:13:28.131114 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-13e835ca-3756-48ae-ba51-e65b1385b63d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:28.132730 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-13e835ca-3756-48ae-ba51-e65b1385b63d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:28.145290 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-13e835ca-3756-48ae-ba51-e65b1385b63d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:28.146277 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-13e835ca-3756-48ae-ba51-e65b1385b63d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:28.146877 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-13e835ca-3756-48ae-ba51-e65b1385b63d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:28.147644 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-13e835ca-3756-48ae-ba51-e65b1385b63d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:28.148146 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-13e835ca-3756-48ae-ba51-e65b1385b63d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:28.148701 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-13e835ca-3756-48ae-ba51-e65b1385b63d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:28.197958 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-2d572e75-94a7-4d75-9822-a6e88cad92e9 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:28.198921 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-2d572e75-94a7-4d75-9822-a6e88cad92e9 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: e221a685-4333-48cb-ab94-67a4c0402490] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:28.202478 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:13:28.212638 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2d572e75-94a7-4d75-9822-a6e88cad92e9 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:28.213595 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2d572e75-94a7-4d75-9822-a6e88cad92e9 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:28.214419 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2d572e75-94a7-4d75-9822-a6e88cad92e9 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:28.215935 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2d572e75-94a7-4d75-9822-a6e88cad92e9 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:28.222526 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2d572e75-94a7-4d75-9822-a6e88cad92e9 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:28.223278 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2d572e75-94a7-4d75-9822-a6e88cad92e9 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:28.328962 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-2d572e75-94a7-4d75-9822-a6e88cad92e9 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:28.339305 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-2d572e75-94a7-4d75-9822-a6e88cad92e9 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490" status: 200 len: 1145 microversion: 2.1 time: 0.144863 Sep 01 14:13:28.341163 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 484/972] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:28 2022] GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490 => generated 1145 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:13:28.401333 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-13e835ca-3756-48ae-ba51-e65b1385b63d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:28.418963 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-13e835ca-3756-48ae-ba51-e65b1385b63d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:28.422476 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-13e835ca-3756-48ae-ba51-e65b1385b63d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:28.425015 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-13e835ca-3756-48ae-ba51-e65b1385b63d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1729 microversion: 2.20 time: 0.305182 Sep 01 14:13:28.426607 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 489/973] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:13:28 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1729 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:13:29.048981 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-6a0f18d0-c416-41bf-a405-ef764e17b746 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:29.050009 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-6a0f18d0-c416-41bf-a405-ef764e17b746 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: f21e2730-924a-436f-a04b-ce7bc9b47ea9] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:29.062670 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6a0f18d0-c416-41bf-a405-ef764e17b746 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:29.063309 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6a0f18d0-c416-41bf-a405-ef764e17b746 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:29.063802 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6a0f18d0-c416-41bf-a405-ef764e17b746 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:29.067279 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6a0f18d0-c416-41bf-a405-ef764e17b746 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:29.068058 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6a0f18d0-c416-41bf-a405-ef764e17b746 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:29.068947 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6a0f18d0-c416-41bf-a405-ef764e17b746 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:29.176642 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-6a0f18d0-c416-41bf-a405-ef764e17b746 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:29.190037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-6a0f18d0-c416-41bf-a405-ef764e17b746 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9" status: 200 len: 1293 microversion: 2.1 time: 0.148521 Sep 01 14:13:29.190876 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 485/974] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:29 2022] GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9 => generated 1293 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:13:29.364894 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-933e8e58-b421-4132-b3e0-ae84a7c0e292 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:29.365676 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-933e8e58-b421-4132-b3e0-ae84a7c0e292 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: e221a685-4333-48cb-ab94-67a4c0402490] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:29.374860 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-933e8e58-b421-4132-b3e0-ae84a7c0e292 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:29.375346 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-933e8e58-b421-4132-b3e0-ae84a7c0e292 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:29.375785 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-933e8e58-b421-4132-b3e0-ae84a7c0e292 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:29.376698 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-933e8e58-b421-4132-b3e0-ae84a7c0e292 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:29.377347 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-933e8e58-b421-4132-b3e0-ae84a7c0e292 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:29.378034 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-933e8e58-b421-4132-b3e0-ae84a7c0e292 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:29.477456 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-933e8e58-b421-4132-b3e0-ae84a7c0e292 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:29.478777 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-437f6f6b-7f1d-4371-a75b-d69976a0d657 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:29.480232 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-437f6f6b-7f1d-4371-a75b-d69976a0d657 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:29.489750 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-933e8e58-b421-4132-b3e0-ae84a7c0e292 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490" status: 200 len: 1145 microversion: 2.1 time: 0.131316 Sep 01 14:13:29.491196 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 490/975] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:29 2022] GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490 => generated 1145 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:29.496555 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-437f6f6b-7f1d-4371-a75b-d69976a0d657 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:29.497404 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-437f6f6b-7f1d-4371-a75b-d69976a0d657 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:29.499848 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-437f6f6b-7f1d-4371-a75b-d69976a0d657 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:29.499848 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-437f6f6b-7f1d-4371-a75b-d69976a0d657 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:29.500179 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-437f6f6b-7f1d-4371-a75b-d69976a0d657 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:29.500578 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-437f6f6b-7f1d-4371-a75b-d69976a0d657 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:29.750709 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-437f6f6b-7f1d-4371-a75b-d69976a0d657 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:29.760815 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-437f6f6b-7f1d-4371-a75b-d69976a0d657 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:29.763012 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-437f6f6b-7f1d-4371-a75b-d69976a0d657 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:29.765726 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-437f6f6b-7f1d-4371-a75b-d69976a0d657 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1729 microversion: 2.20 time: 0.294886 Sep 01 14:13:29.781557 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 486/976] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:13:29 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1729 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:13:29.916031 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-46358720-69df-4001-94bd-9486b4e52bfc tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:29.916806 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-46358720-69df-4001-94bd-9486b4e52bfc tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 8a8b6392-8237-47f3-9a9b-7a80f18f71c3] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:29.927324 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-46358720-69df-4001-94bd-9486b4e52bfc tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:29.928635 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-46358720-69df-4001-94bd-9486b4e52bfc tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:29.930091 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-46358720-69df-4001-94bd-9486b4e52bfc tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:29.931752 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-46358720-69df-4001-94bd-9486b4e52bfc tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:29.932977 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-46358720-69df-4001-94bd-9486b4e52bfc tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:29.934039 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-46358720-69df-4001-94bd-9486b4e52bfc tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:29.978546 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.wsgi [None req-46358720-69df-4001-94bd-9486b4e52bfc tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] HTTP exception thrown: Instance 8a8b6392-8237-47f3-9a9b-7a80f18f71c3 could not be found. Sep 01 14:13:29.980753 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-46358720-69df-4001-94bd-9486b4e52bfc tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Request method failure captured: Sep 01 14:13:29.980753 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: request: DELETE /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3 HTTP/1.1 Sep 01 14:13:29.980753 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept: application/json Sep 01 14:13:29.980753 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept-Encoding: identity Sep 01 14:13:29.980753 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Connection: close Sep 01 14:13:29.980753 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Length: 0 Sep 01 14:13:29.980753 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Type: application/json Sep 01 14:13:29.980753 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Host: 10.222.0.25 Sep 01 14:13:29.980753 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Openstack-System-Scope: None Sep 01 14:13:29.980753 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: User-Agent: python-urllib3/1.26.12 Sep 01 14:13:29.980753 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Auth-Token: gAAAAABjELxJFCqHL6iDW93p2fAK82qpj7L1D7D7ilryiMV3DyGHDC5twKjpobCzpdbmKrw1i62S3hizpMOIs5ob_AyQm5W6dnNLK6OpjiuLVoCJElwf7M_K99jJdNFPOzu8jRRuhJkpEHOKHKZFt9UvUOXe97P6WYXoFXwhzBcefsvHS2el000 Sep 01 14:13:29.980753 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Id: None Sep 01 14:13:29.980753 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Name: None Sep 01 14:13:29.980753 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Identity-Status: Confirmed Sep 01 14:13:29.980753 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Is-Admin-Project: True Sep 01 14:13:29.980753 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Id: default Sep 01 14:13:29.980753 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Name: Default Sep 01 14:13:29.980753 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Id: eaba67e3a54f4191b9b924305a83e4eb Sep 01 14:13:29.980753 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Name: tempest-AttachVolumeTestJSON-224345679 Sep 01 14:13:29.980753 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Role: member,reader Sep 01 14:13:29.980753 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Roles: member,reader Sep 01 14:13:29.983365 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaba67e3a54f4191b9b924305a83e4eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eaba67e3a54f4191b9b924305a83e4eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaba67e3a54f4191b9b924305a83e4eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eaba67e3a54f4191b9b924305a83e4eb"}]}] Sep 01 14:13:29.983365 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant: tempest-AttachVolumeTestJSON-224345679 Sep 01 14:13:29.983365 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Id: eaba67e3a54f4191b9b924305a83e4eb Sep 01 14:13:29.983365 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Name: tempest-AttachVolumeTestJSON-224345679 Sep 01 14:13:29.983365 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User: tempest-AttachVolumeTestJSON-224345679-project Sep 01 14:13:29.983365 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Id: default Sep 01 14:13:29.983365 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Name: Default Sep 01 14:13:29.983365 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Id: ff664c7ba095413daad6b3f1ebc49cc0 Sep 01 14:13:29.983365 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Name: tempest-AttachVolumeTestJSON-224345679-project Sep 01 14:13:29.983365 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: method: > Sep 01 14:13:29.983365 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: exception: Instance 8a8b6392-8237-47f3-9a9b-7a80f18f71c3 could not be found. Sep 01 14:13:29.983365 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: action_args: {'id': '8a8b6392-8237-47f3-9a9b-7a80f18f71c3'} Sep 01 14:13:29.984687 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:13:29.984687 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:13:29.984687 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:13:29.984687 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:13:29.984687 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:13:29.984687 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:13:29.984687 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:13:29.984687 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:13:29.984687 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:13:29.984687 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:13:29.984687 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a8b6392-8237-47f3-9a9b-7a80f18f71c3 could not be found. Sep 01 14:13:29.984687 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:13:29.984687 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:13:29.984687 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:13:29.984687 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:13:29.984687 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:13:29.984687 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:13:29.984687 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:13:29.984687 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:13:29.984687 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:13:29.987301 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:13:29.987301 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 14:13:29.987301 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 14:13:29.987301 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 14:13:29.987301 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 14:13:29.987301 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:13:29.987301 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:13:29.987301 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:13:29.987301 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:13:29.987301 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a8b6392-8237-47f3-9a9b-7a80f18f71c3 could not be found. Sep 01 14:13:29.987301 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:13:29.987301 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:13:29.987301 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:13:29.987301 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:13:29.987301 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:13:29.987301 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:13:29.987301 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:13:29.987301 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:13:29.987301 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a8b6392-8237-47f3-9a9b-7a80f18f71c3 could not be found. Sep 01 14:13:29.987301 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:13:29.990736 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-46358720-69df-4001-94bd-9486b4e52bfc tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Returning 404 to user: Instance 8a8b6392-8237-47f3-9a9b-7a80f18f71c3 could not be found. {{(pid=121340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:13:29.991837 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-46358720-69df-4001-94bd-9486b4e52bfc tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3" status: 404 len: 111 microversion: 2.1 time: 0.080134 Sep 01 14:13:29.996469 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 491/977] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 14:13:29 2022] DELETE /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:13:30.006179 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-edb3c6c1-288d-45b7-aa03-56a2514c021d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:30.007378 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-edb3c6c1-288d-45b7-aa03-56a2514c021d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 8a8b6392-8237-47f3-9a9b-7a80f18f71c3] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:30.032980 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-edb3c6c1-288d-45b7-aa03-56a2514c021d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:30.034298 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-edb3c6c1-288d-45b7-aa03-56a2514c021d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:30.035562 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-edb3c6c1-288d-45b7-aa03-56a2514c021d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:30.037706 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-edb3c6c1-288d-45b7-aa03-56a2514c021d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:30.038375 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-edb3c6c1-288d-45b7-aa03-56a2514c021d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:30.039173 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-edb3c6c1-288d-45b7-aa03-56a2514c021d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:30.072786 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.wsgi [None req-edb3c6c1-288d-45b7-aa03-56a2514c021d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] HTTP exception thrown: Instance 8a8b6392-8237-47f3-9a9b-7a80f18f71c3 could not be found. Sep 01 14:13:30.077836 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-edb3c6c1-288d-45b7-aa03-56a2514c021d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Request method failure captured: Sep 01 14:13:30.077836 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: request: GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3 HTTP/1.1 Sep 01 14:13:30.077836 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept: application/json Sep 01 14:13:30.077836 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept-Encoding: identity Sep 01 14:13:30.077836 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Connection: close Sep 01 14:13:30.077836 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Length: 0 Sep 01 14:13:30.077836 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Type: application/json Sep 01 14:13:30.077836 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Host: 10.222.0.25 Sep 01 14:13:30.077836 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Openstack-System-Scope: None Sep 01 14:13:30.077836 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: User-Agent: python-urllib3/1.26.12 Sep 01 14:13:30.077836 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Auth-Token: gAAAAABjELxJFCqHL6iDW93p2fAK82qpj7L1D7D7ilryiMV3DyGHDC5twKjpobCzpdbmKrw1i62S3hizpMOIs5ob_AyQm5W6dnNLK6OpjiuLVoCJElwf7M_K99jJdNFPOzu8jRRuhJkpEHOKHKZFt9UvUOXe97P6WYXoFXwhzBcefsvHS2el000 Sep 01 14:13:30.077836 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Id: None Sep 01 14:13:30.077836 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Name: None Sep 01 14:13:30.077836 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Identity-Status: Confirmed Sep 01 14:13:30.077836 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Is-Admin-Project: True Sep 01 14:13:30.077836 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Id: default Sep 01 14:13:30.077836 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Name: Default Sep 01 14:13:30.077836 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Id: eaba67e3a54f4191b9b924305a83e4eb Sep 01 14:13:30.077836 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Name: tempest-AttachVolumeTestJSON-224345679 Sep 01 14:13:30.077836 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Role: member,reader Sep 01 14:13:30.077836 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Roles: member,reader Sep 01 14:13:30.080232 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaba67e3a54f4191b9b924305a83e4eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eaba67e3a54f4191b9b924305a83e4eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaba67e3a54f4191b9b924305a83e4eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eaba67e3a54f4191b9b924305a83e4eb"}]}] Sep 01 14:13:30.080232 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant: tempest-AttachVolumeTestJSON-224345679 Sep 01 14:13:30.080232 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Id: eaba67e3a54f4191b9b924305a83e4eb Sep 01 14:13:30.080232 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Name: tempest-AttachVolumeTestJSON-224345679 Sep 01 14:13:30.080232 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User: tempest-AttachVolumeTestJSON-224345679-project Sep 01 14:13:30.080232 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Id: default Sep 01 14:13:30.080232 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Name: Default Sep 01 14:13:30.080232 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Id: ff664c7ba095413daad6b3f1ebc49cc0 Sep 01 14:13:30.080232 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Name: tempest-AttachVolumeTestJSON-224345679-project Sep 01 14:13:30.080232 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: method: > Sep 01 14:13:30.080232 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: exception: Instance 8a8b6392-8237-47f3-9a9b-7a80f18f71c3 could not be found. Sep 01 14:13:30.080232 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: action_args: {'id': '8a8b6392-8237-47f3-9a9b-7a80f18f71c3'} Sep 01 14:13:30.082003 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:13:30.082003 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:13:30.082003 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:13:30.082003 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:13:30.082003 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:13:30.082003 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:13:30.082003 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:13:30.082003 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:13:30.082003 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:13:30.082003 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:13:30.082003 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a8b6392-8237-47f3-9a9b-7a80f18f71c3 could not be found. Sep 01 14:13:30.082003 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:13:30.082003 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:13:30.082003 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:13:30.082003 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:13:30.082003 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:13:30.082003 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:13:30.082003 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:13:30.082003 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:13:30.082003 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:13:30.084389 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:13:30.084389 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:13:30.084389 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:13:30.084389 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:13:30.084389 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:13:30.084389 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:13:30.084389 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:13:30.084389 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a8b6392-8237-47f3-9a9b-7a80f18f71c3 could not be found. Sep 01 14:13:30.084389 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:13:30.084389 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:13:30.084389 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:13:30.084389 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:13:30.084389 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:13:30.084389 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:13:30.084389 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:13:30.084389 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:13:30.084389 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a8b6392-8237-47f3-9a9b-7a80f18f71c3 could not be found. Sep 01 14:13:30.084389 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:13:30.092931 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-edb3c6c1-288d-45b7-aa03-56a2514c021d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Returning 404 to user: Instance 8a8b6392-8237-47f3-9a9b-7a80f18f71c3 could not be found. {{(pid=121339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:13:30.092931 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-edb3c6c1-288d-45b7-aa03-56a2514c021d tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3" status: 404 len: 111 microversion: 2.1 time: 0.089711 Sep 01 14:13:30.092931 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 487/978] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:29 2022] GET /compute/v2.1/servers/8a8b6392-8237-47f3-9a9b-7a80f18f71c3 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:13:30.226405 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-5575abd0-e7a0-4c96-88cb-a3936e141338 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:30.227073 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-5575abd0-e7a0-4c96-88cb-a3936e141338 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: f21e2730-924a-436f-a04b-ce7bc9b47ea9] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:30.238293 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5575abd0-e7a0-4c96-88cb-a3936e141338 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:30.239182 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5575abd0-e7a0-4c96-88cb-a3936e141338 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:30.239671 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5575abd0-e7a0-4c96-88cb-a3936e141338 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:30.240545 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5575abd0-e7a0-4c96-88cb-a3936e141338 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:30.241098 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5575abd0-e7a0-4c96-88cb-a3936e141338 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:30.241452 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5575abd0-e7a0-4c96-88cb-a3936e141338 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:30.395474 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-5575abd0-e7a0-4c96-88cb-a3936e141338 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:30.410989 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-5575abd0-e7a0-4c96-88cb-a3936e141338 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9" status: 200 len: 1293 microversion: 2.1 time: 0.190919 Sep 01 14:13:30.412092 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 492/979] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:30 2022] GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9 => generated 1293 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:30.530791 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-e8018813-07a2-4b17-a9e1-8b1ea2348543 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:30.531868 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-e8018813-07a2-4b17-a9e1-8b1ea2348543 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: e221a685-4333-48cb-ab94-67a4c0402490] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:30.542717 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e8018813-07a2-4b17-a9e1-8b1ea2348543 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:30.544172 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e8018813-07a2-4b17-a9e1-8b1ea2348543 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:30.545122 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e8018813-07a2-4b17-a9e1-8b1ea2348543 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:30.546613 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e8018813-07a2-4b17-a9e1-8b1ea2348543 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:30.547742 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e8018813-07a2-4b17-a9e1-8b1ea2348543 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:30.548431 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e8018813-07a2-4b17-a9e1-8b1ea2348543 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:30.688715 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-e8018813-07a2-4b17-a9e1-8b1ea2348543 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:30.706303 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-e8018813-07a2-4b17-a9e1-8b1ea2348543 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490" status: 200 len: 1145 microversion: 2.1 time: 0.184888 Sep 01 14:13:30.708426 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 488/980] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:30 2022] GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490 => generated 1145 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:30.802184 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-c289269d-5ded-4679-a672-2784f42c6cbe tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:30.802794 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-c289269d-5ded-4679-a672-2784f42c6cbe tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:30.825139 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c289269d-5ded-4679-a672-2784f42c6cbe tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:30.826190 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c289269d-5ded-4679-a672-2784f42c6cbe tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:30.827025 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c289269d-5ded-4679-a672-2784f42c6cbe tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:30.828440 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c289269d-5ded-4679-a672-2784f42c6cbe tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:30.829303 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c289269d-5ded-4679-a672-2784f42c6cbe tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:30.830270 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c289269d-5ded-4679-a672-2784f42c6cbe tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:31.111435 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-c289269d-5ded-4679-a672-2784f42c6cbe tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:31.126186 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-c289269d-5ded-4679-a672-2784f42c6cbe tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:31.128166 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-c289269d-5ded-4679-a672-2784f42c6cbe tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:31.130378 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-c289269d-5ded-4679-a672-2784f42c6cbe tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1729 microversion: 2.20 time: 0.332642 Sep 01 14:13:31.130378 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 493/981] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:13:30 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1729 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:13:31.442485 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-40fbd073-286f-4e4b-acf1-65eef663386f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:31.443805 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-40fbd073-286f-4e4b-acf1-65eef663386f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: f21e2730-924a-436f-a04b-ce7bc9b47ea9] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:31.453399 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell0:SELECT=2 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:13:31.455468 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-40fbd073-286f-4e4b-acf1-65eef663386f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:31.456156 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-40fbd073-286f-4e4b-acf1-65eef663386f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:31.457670 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-40fbd073-286f-4e4b-acf1-65eef663386f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:31.458937 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-40fbd073-286f-4e4b-acf1-65eef663386f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:31.459592 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-40fbd073-286f-4e4b-acf1-65eef663386f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:31.460193 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-40fbd073-286f-4e4b-acf1-65eef663386f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:31.529131 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-598e2625-6a2c-4a36-92e3-5085c1827153 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:31.530328 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-598e2625-6a2c-4a36-92e3-5085c1827153 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:31.540994 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-598e2625-6a2c-4a36-92e3-5085c1827153 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:31.543018 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-598e2625-6a2c-4a36-92e3-5085c1827153 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:31.543662 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-598e2625-6a2c-4a36-92e3-5085c1827153 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:31.545346 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-598e2625-6a2c-4a36-92e3-5085c1827153 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:31.546367 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-598e2625-6a2c-4a36-92e3-5085c1827153 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:31.547106 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-598e2625-6a2c-4a36-92e3-5085c1827153 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:31.574280 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.wsgi [None req-598e2625-6a2c-4a36-92e3-5085c1827153 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] HTTP exception thrown: Instance 1c2b8351-0db7-45ab-848a-1e339e67bcf7 could not be found. Sep 01 14:13:31.577140 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-598e2625-6a2c-4a36-92e3-5085c1827153 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Request method failure captured: Sep 01 14:13:31.577140 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: request: DELETE /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 HTTP/1.1 Sep 01 14:13:31.577140 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept: application/json Sep 01 14:13:31.577140 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept-Encoding: identity Sep 01 14:13:31.577140 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Connection: close Sep 01 14:13:31.577140 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Length: 0 Sep 01 14:13:31.577140 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Type: application/json Sep 01 14:13:31.577140 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Host: 10.222.0.25 Sep 01 14:13:31.577140 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Openstack-System-Scope: None Sep 01 14:13:31.577140 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: User-Agent: python-urllib3/1.26.12 Sep 01 14:13:31.577140 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Auth-Token: gAAAAABjELxJFCqHL6iDW93p2fAK82qpj7L1D7D7ilryiMV3DyGHDC5twKjpobCzpdbmKrw1i62S3hizpMOIs5ob_AyQm5W6dnNLK6OpjiuLVoCJElwf7M_K99jJdNFPOzu8jRRuhJkpEHOKHKZFt9UvUOXe97P6WYXoFXwhzBcefsvHS2el000 Sep 01 14:13:31.577140 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Id: None Sep 01 14:13:31.577140 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Name: None Sep 01 14:13:31.577140 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Identity-Status: Confirmed Sep 01 14:13:31.577140 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Is-Admin-Project: True Sep 01 14:13:31.577140 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Id: default Sep 01 14:13:31.577140 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Name: Default Sep 01 14:13:31.577140 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Id: eaba67e3a54f4191b9b924305a83e4eb Sep 01 14:13:31.577140 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Name: tempest-AttachVolumeTestJSON-224345679 Sep 01 14:13:31.577140 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Role: member,reader Sep 01 14:13:31.577140 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Roles: member,reader Sep 01 14:13:31.578665 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaba67e3a54f4191b9b924305a83e4eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eaba67e3a54f4191b9b924305a83e4eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaba67e3a54f4191b9b924305a83e4eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eaba67e3a54f4191b9b924305a83e4eb"}]}] Sep 01 14:13:31.578665 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant: tempest-AttachVolumeTestJSON-224345679 Sep 01 14:13:31.578665 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Id: eaba67e3a54f4191b9b924305a83e4eb Sep 01 14:13:31.578665 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Name: tempest-AttachVolumeTestJSON-224345679 Sep 01 14:13:31.578665 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User: tempest-AttachVolumeTestJSON-224345679-project Sep 01 14:13:31.578665 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Id: default Sep 01 14:13:31.578665 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Name: Default Sep 01 14:13:31.578665 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Id: ff664c7ba095413daad6b3f1ebc49cc0 Sep 01 14:13:31.578665 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Name: tempest-AttachVolumeTestJSON-224345679-project Sep 01 14:13:31.578665 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: method: > Sep 01 14:13:31.578665 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: exception: Instance 1c2b8351-0db7-45ab-848a-1e339e67bcf7 could not be found. Sep 01 14:13:31.578665 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: action_args: {'id': '1c2b8351-0db7-45ab-848a-1e339e67bcf7'} Sep 01 14:13:31.579523 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:13:31.579523 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:13:31.579523 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:13:31.579523 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:13:31.579523 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:13:31.579523 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:13:31.579523 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:13:31.579523 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:13:31.579523 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:13:31.579523 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:13:31.579523 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c2b8351-0db7-45ab-848a-1e339e67bcf7 could not be found. Sep 01 14:13:31.579523 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:13:31.579523 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:13:31.579523 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:13:31.579523 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:13:31.579523 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:13:31.579523 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:13:31.579523 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:13:31.579523 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:13:31.579523 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:13:31.580770 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:13:31.580770 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 14:13:31.580770 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 14:13:31.580770 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 14:13:31.580770 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 14:13:31.580770 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:13:31.580770 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:13:31.580770 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:13:31.580770 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:13:31.580770 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c2b8351-0db7-45ab-848a-1e339e67bcf7 could not be found. Sep 01 14:13:31.580770 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:13:31.580770 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:13:31.580770 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:13:31.580770 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:13:31.580770 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:13:31.580770 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:13:31.580770 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:13:31.580770 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:13:31.580770 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c2b8351-0db7-45ab-848a-1e339e67bcf7 could not be found. Sep 01 14:13:31.580770 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:13:31.586975 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-598e2625-6a2c-4a36-92e3-5085c1827153 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Returning 404 to user: Instance 1c2b8351-0db7-45ab-848a-1e339e67bcf7 could not be found. {{(pid=121340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:13:31.591781 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-598e2625-6a2c-4a36-92e3-5085c1827153 tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 404 len: 111 microversion: 2.1 time: 0.063102 Sep 01 14:13:31.591781 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 494/982] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 14:13:31 2022] DELETE /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:13:31.608803 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-ebced010-b87d-498d-8bbc-3ecde172691c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:31.610326 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-ebced010-b87d-498d-8bbc-3ecde172691c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] [instance: 1c2b8351-0db7-45ab-848a-1e339e67bcf7] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:31.616711 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ebced010-b87d-498d-8bbc-3ecde172691c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:31.617275 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ebced010-b87d-498d-8bbc-3ecde172691c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:31.617720 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ebced010-b87d-498d-8bbc-3ecde172691c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:31.618611 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ebced010-b87d-498d-8bbc-3ecde172691c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:31.619076 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ebced010-b87d-498d-8bbc-3ecde172691c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:31.619504 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ebced010-b87d-498d-8bbc-3ecde172691c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:31.646077 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-40fbd073-286f-4e4b-acf1-65eef663386f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:31.654136 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.wsgi [None req-ebced010-b87d-498d-8bbc-3ecde172691c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] HTTP exception thrown: Instance 1c2b8351-0db7-45ab-848a-1e339e67bcf7 could not be found. Sep 01 14:13:31.655725 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-ebced010-b87d-498d-8bbc-3ecde172691c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Request method failure captured: Sep 01 14:13:31.655725 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: request: GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 HTTP/1.1 Sep 01 14:13:31.655725 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept: application/json Sep 01 14:13:31.655725 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept-Encoding: identity Sep 01 14:13:31.655725 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Connection: close Sep 01 14:13:31.655725 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Length: 0 Sep 01 14:13:31.655725 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Type: application/json Sep 01 14:13:31.655725 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Host: 10.222.0.25 Sep 01 14:13:31.655725 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Openstack-System-Scope: None Sep 01 14:13:31.655725 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: User-Agent: python-urllib3/1.26.12 Sep 01 14:13:31.655725 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Auth-Token: gAAAAABjELxJFCqHL6iDW93p2fAK82qpj7L1D7D7ilryiMV3DyGHDC5twKjpobCzpdbmKrw1i62S3hizpMOIs5ob_AyQm5W6dnNLK6OpjiuLVoCJElwf7M_K99jJdNFPOzu8jRRuhJkpEHOKHKZFt9UvUOXe97P6WYXoFXwhzBcefsvHS2el000 Sep 01 14:13:31.655725 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Id: None Sep 01 14:13:31.655725 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Name: None Sep 01 14:13:31.655725 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Identity-Status: Confirmed Sep 01 14:13:31.655725 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Is-Admin-Project: True Sep 01 14:13:31.655725 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Id: default Sep 01 14:13:31.655725 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Name: Default Sep 01 14:13:31.655725 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Id: eaba67e3a54f4191b9b924305a83e4eb Sep 01 14:13:31.655725 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Name: tempest-AttachVolumeTestJSON-224345679 Sep 01 14:13:31.655725 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Role: member,reader Sep 01 14:13:31.655725 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Roles: member,reader Sep 01 14:13:31.657214 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaba67e3a54f4191b9b924305a83e4eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eaba67e3a54f4191b9b924305a83e4eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eaba67e3a54f4191b9b924305a83e4eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eaba67e3a54f4191b9b924305a83e4eb"}]}] Sep 01 14:13:31.657214 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant: tempest-AttachVolumeTestJSON-224345679 Sep 01 14:13:31.657214 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Id: eaba67e3a54f4191b9b924305a83e4eb Sep 01 14:13:31.657214 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Name: tempest-AttachVolumeTestJSON-224345679 Sep 01 14:13:31.657214 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User: tempest-AttachVolumeTestJSON-224345679-project Sep 01 14:13:31.657214 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Id: default Sep 01 14:13:31.657214 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Name: Default Sep 01 14:13:31.657214 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Id: ff664c7ba095413daad6b3f1ebc49cc0 Sep 01 14:13:31.657214 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Name: tempest-AttachVolumeTestJSON-224345679-project Sep 01 14:13:31.657214 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: method: > Sep 01 14:13:31.657214 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: exception: Instance 1c2b8351-0db7-45ab-848a-1e339e67bcf7 could not be found. Sep 01 14:13:31.657214 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: action_args: {'id': '1c2b8351-0db7-45ab-848a-1e339e67bcf7'} Sep 01 14:13:31.658177 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:13:31.658177 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:13:31.658177 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:13:31.658177 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:13:31.658177 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:13:31.658177 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:13:31.658177 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:13:31.658177 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:13:31.658177 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:13:31.658177 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:13:31.658177 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c2b8351-0db7-45ab-848a-1e339e67bcf7 could not be found. Sep 01 14:13:31.658177 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:13:31.658177 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:13:31.658177 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:13:31.658177 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:13:31.658177 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:13:31.658177 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:13:31.658177 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:13:31.658177 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:13:31.658177 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:13:31.659649 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:13:31.659649 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:13:31.659649 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:13:31.659649 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:13:31.659649 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:13:31.659649 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:13:31.659649 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:13:31.659649 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c2b8351-0db7-45ab-848a-1e339e67bcf7 could not be found. Sep 01 14:13:31.659649 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:13:31.659649 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:13:31.659649 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:13:31.659649 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:13:31.659649 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:13:31.659649 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:13:31.659649 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:13:31.659649 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:13:31.659649 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c2b8351-0db7-45ab-848a-1e339e67bcf7 could not be found. Sep 01 14:13:31.659649 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:13:31.661827 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-ebced010-b87d-498d-8bbc-3ecde172691c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] Returning 404 to user: Instance 1c2b8351-0db7-45ab-848a-1e339e67bcf7 could not be found. {{(pid=121340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:13:31.662900 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-ebced010-b87d-498d-8bbc-3ecde172691c tempest-AttachVolumeTestJSON-224345679 tempest-AttachVolumeTestJSON-224345679-project] 10.222.0.25 "GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7" status: 404 len: 111 microversion: 2.1 time: 0.058789 Sep 01 14:13:31.663753 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-40fbd073-286f-4e4b-acf1-65eef663386f tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9" status: 200 len: 1293 microversion: 2.1 time: 0.229380 Sep 01 14:13:31.664220 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 495/983] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:31 2022] GET /compute/v2.1/servers/1c2b8351-0db7-45ab-848a-1e339e67bcf7 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:13:31.664468 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 489/984] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:31 2022] GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9 => generated 1293 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:31.733700 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-5a0f4930-5d3b-474a-8f6c-eb2e21ffb33b tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:31.734353 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-5a0f4930-5d3b-474a-8f6c-eb2e21ffb33b tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: e221a685-4333-48cb-ab94-67a4c0402490] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:31.740864 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5a0f4930-5d3b-474a-8f6c-eb2e21ffb33b tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:31.741360 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5a0f4930-5d3b-474a-8f6c-eb2e21ffb33b tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:31.742228 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5a0f4930-5d3b-474a-8f6c-eb2e21ffb33b tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:31.742958 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5a0f4930-5d3b-474a-8f6c-eb2e21ffb33b tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:31.743713 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5a0f4930-5d3b-474a-8f6c-eb2e21ffb33b tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:31.744506 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5a0f4930-5d3b-474a-8f6c-eb2e21ffb33b tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:31.878307 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-5a0f4930-5d3b-474a-8f6c-eb2e21ffb33b tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:31.900660 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-5a0f4930-5d3b-474a-8f6c-eb2e21ffb33b tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490" status: 200 len: 1145 microversion: 2.1 time: 0.171554 Sep 01 14:13:31.914431 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 496/985] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:31 2022] GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490 => generated 1145 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:32.158480 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-1d7c0647-92a7-4866-b360-95d717227d05 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:32.159080 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-1d7c0647-92a7-4866-b360-95d717227d05 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:32.166265 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1d7c0647-92a7-4866-b360-95d717227d05 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:32.166774 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1d7c0647-92a7-4866-b360-95d717227d05 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:32.167225 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1d7c0647-92a7-4866-b360-95d717227d05 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:32.167981 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1d7c0647-92a7-4866-b360-95d717227d05 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:32.168499 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1d7c0647-92a7-4866-b360-95d717227d05 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:32.168936 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1d7c0647-92a7-4866-b360-95d717227d05 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:32.197966 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:13:32.547832 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-1d7c0647-92a7-4866-b360-95d717227d05 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:32.581991 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-1d7c0647-92a7-4866-b360-95d717227d05 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:32.585003 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-1d7c0647-92a7-4866-b360-95d717227d05 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:32.587122 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-1d7c0647-92a7-4866-b360-95d717227d05 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1729 microversion: 2.20 time: 0.432630 Sep 01 14:13:32.596627 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 490/986] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:13:32 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1729 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:13:32.705892 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-b3c2d1c6-138f-42ea-91ea-7b078ffa90a5 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:32.709359 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-b3c2d1c6-138f-42ea-91ea-7b078ffa90a5 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: f21e2730-924a-436f-a04b-ce7bc9b47ea9] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:32.729426 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell0:SELECT=2 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:13:32.736676 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b3c2d1c6-138f-42ea-91ea-7b078ffa90a5 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:32.738252 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b3c2d1c6-138f-42ea-91ea-7b078ffa90a5 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:32.739490 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b3c2d1c6-138f-42ea-91ea-7b078ffa90a5 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:32.741107 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b3c2d1c6-138f-42ea-91ea-7b078ffa90a5 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:32.742319 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b3c2d1c6-138f-42ea-91ea-7b078ffa90a5 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:32.743549 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b3c2d1c6-138f-42ea-91ea-7b078ffa90a5 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:32.931514 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-b3c2d1c6-138f-42ea-91ea-7b078ffa90a5 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:32.933027 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-815ba04f-822c-4056-a77a-b9cbf2ac5bfc tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:32.934098 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-815ba04f-822c-4056-a77a-b9cbf2ac5bfc tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: e221a685-4333-48cb-ab94-67a4c0402490] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:32.947024 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-b3c2d1c6-138f-42ea-91ea-7b078ffa90a5 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9" status: 200 len: 1293 microversion: 2.1 time: 0.252338 Sep 01 14:13:32.953875 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 497/987] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:32 2022] GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9 => generated 1293 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:32.960162 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-815ba04f-822c-4056-a77a-b9cbf2ac5bfc tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:32.960686 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-815ba04f-822c-4056-a77a-b9cbf2ac5bfc tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:32.961136 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-815ba04f-822c-4056-a77a-b9cbf2ac5bfc tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:32.961925 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-815ba04f-822c-4056-a77a-b9cbf2ac5bfc tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:32.968166 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-815ba04f-822c-4056-a77a-b9cbf2ac5bfc tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:32.968714 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-815ba04f-822c-4056-a77a-b9cbf2ac5bfc tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:33.061919 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-815ba04f-822c-4056-a77a-b9cbf2ac5bfc tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:33.083167 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-815ba04f-822c-4056-a77a-b9cbf2ac5bfc tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490" status: 200 len: 1145 microversion: 2.1 time: 0.156866 Sep 01 14:13:33.085316 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 491/988] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:32 2022] GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490 => generated 1145 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:13:33.656087 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-1b251870-a05b-4f0b-b572-f44058530574 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:33.656855 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-1b251870-a05b-4f0b-b572-f44058530574 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:33.667960 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1b251870-a05b-4f0b-b572-f44058530574 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:33.668453 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1b251870-a05b-4f0b-b572-f44058530574 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:33.668953 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1b251870-a05b-4f0b-b572-f44058530574 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:33.670389 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1b251870-a05b-4f0b-b572-f44058530574 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:33.670897 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1b251870-a05b-4f0b-b572-f44058530574 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:33.671314 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1b251870-a05b-4f0b-b572-f44058530574 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:33.979949 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-691f96a9-6849-413f-8fa5-b84519268017 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:33.982782 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-691f96a9-6849-413f-8fa5-b84519268017 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: f21e2730-924a-436f-a04b-ce7bc9b47ea9] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:33.988448 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell0:SELECT=14 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:13:33.995382 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-691f96a9-6849-413f-8fa5-b84519268017 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:33.996472 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-691f96a9-6849-413f-8fa5-b84519268017 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:33.997285 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-691f96a9-6849-413f-8fa5-b84519268017 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:33.998736 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-691f96a9-6849-413f-8fa5-b84519268017 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:33.999715 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-691f96a9-6849-413f-8fa5-b84519268017 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:34.000419 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-691f96a9-6849-413f-8fa5-b84519268017 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:34.020276 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-1b251870-a05b-4f0b-b572-f44058530574 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:34.039594 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-1b251870-a05b-4f0b-b572-f44058530574 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:34.041090 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-1b251870-a05b-4f0b-b572-f44058530574 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:34.043053 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-1b251870-a05b-4f0b-b572-f44058530574 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1729 microversion: 2.20 time: 0.392344 Sep 01 14:13:34.055068 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 498/989] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:13:33 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1729 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:13:34.111706 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-8b9e445a-c7e1-4534-99ee-23a12382d75d tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:34.112831 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-8b9e445a-c7e1-4534-99ee-23a12382d75d tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: e221a685-4333-48cb-ab94-67a4c0402490] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:34.123303 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8b9e445a-c7e1-4534-99ee-23a12382d75d tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:34.125025 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8b9e445a-c7e1-4534-99ee-23a12382d75d tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:34.125219 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8b9e445a-c7e1-4534-99ee-23a12382d75d tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:34.126567 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8b9e445a-c7e1-4534-99ee-23a12382d75d tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:34.127504 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8b9e445a-c7e1-4534-99ee-23a12382d75d tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:34.128672 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-8b9e445a-c7e1-4534-99ee-23a12382d75d tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:34.132515 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-691f96a9-6849-413f-8fa5-b84519268017 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:34.144436 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-691f96a9-6849-413f-8fa5-b84519268017 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9" status: 200 len: 1293 microversion: 2.1 time: 0.171958 Sep 01 14:13:34.159465 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 492/990] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:33 2022] GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9 => generated 1293 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:34.265316 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-8b9e445a-c7e1-4534-99ee-23a12382d75d tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:34.276289 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-8b9e445a-c7e1-4534-99ee-23a12382d75d tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490" status: 200 len: 1145 microversion: 2.1 time: 0.172815 Sep 01 14:13:34.279673 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 499/991] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:34 2022] GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490 => generated 1145 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:35.078977 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-2bfa61b5-18b1-457a-b3f8-9134635a7f3a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:35.080919 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-2bfa61b5-18b1-457a-b3f8-9134635a7f3a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:35.093515 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2bfa61b5-18b1-457a-b3f8-9134635a7f3a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:35.094794 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2bfa61b5-18b1-457a-b3f8-9134635a7f3a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:35.095884 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2bfa61b5-18b1-457a-b3f8-9134635a7f3a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:35.097414 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2bfa61b5-18b1-457a-b3f8-9134635a7f3a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:35.098830 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2bfa61b5-18b1-457a-b3f8-9134635a7f3a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:35.100104 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2bfa61b5-18b1-457a-b3f8-9134635a7f3a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:35.179740 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-314ba98d-3294-477e-9c86-383b44a970d2 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:35.180651 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-314ba98d-3294-477e-9c86-383b44a970d2 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: f21e2730-924a-436f-a04b-ce7bc9b47ea9] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:35.200245 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell0:SELECT=8 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:13:35.204607 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-314ba98d-3294-477e-9c86-383b44a970d2 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:35.207233 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-314ba98d-3294-477e-9c86-383b44a970d2 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:35.213032 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-314ba98d-3294-477e-9c86-383b44a970d2 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:35.213032 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-314ba98d-3294-477e-9c86-383b44a970d2 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:35.213032 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-314ba98d-3294-477e-9c86-383b44a970d2 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:35.217432 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-314ba98d-3294-477e-9c86-383b44a970d2 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:35.343096 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-314ba98d-3294-477e-9c86-383b44a970d2 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:35.358377 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-314ba98d-3294-477e-9c86-383b44a970d2 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9" status: 200 len: 1293 microversion: 2.1 time: 0.192490 Sep 01 14:13:35.358971 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 500/992] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:35 2022] GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9 => generated 1293 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:35.371298 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-84341fd9-91d1-44c9-846b-c806153c1bb9 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:35.372020 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-84341fd9-91d1-44c9-846b-c806153c1bb9 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: e221a685-4333-48cb-ab94-67a4c0402490] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:35.388463 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-84341fd9-91d1-44c9-846b-c806153c1bb9 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:35.396311 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-84341fd9-91d1-44c9-846b-c806153c1bb9 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:35.396311 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-84341fd9-91d1-44c9-846b-c806153c1bb9 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:35.396311 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-84341fd9-91d1-44c9-846b-c806153c1bb9 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:35.396311 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-84341fd9-91d1-44c9-846b-c806153c1bb9 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:35.397010 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-84341fd9-91d1-44c9-846b-c806153c1bb9 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:35.477869 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-2bfa61b5-18b1-457a-b3f8-9134635a7f3a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:35.492350 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-2bfa61b5-18b1-457a-b3f8-9134635a7f3a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:35.494068 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-2bfa61b5-18b1-457a-b3f8-9134635a7f3a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:35.499909 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-2bfa61b5-18b1-457a-b3f8-9134635a7f3a tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1729 microversion: 2.20 time: 0.428493 Sep 01 14:13:35.500615 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 493/993] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:13:35 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1729 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:13:35.629558 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-84341fd9-91d1-44c9-846b-c806153c1bb9 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:35.636587 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-84341fd9-91d1-44c9-846b-c806153c1bb9 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490" status: 200 len: 1137 microversion: 2.1 time: 0.275648 Sep 01 14:13:35.637473 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 501/994] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:35 2022] GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490 => generated 1137 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:36.395517 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-205e5ec0-2a6a-4096-9b48-bf28c3b46349 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:36.396141 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-205e5ec0-2a6a-4096-9b48-bf28c3b46349 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: f21e2730-924a-436f-a04b-ce7bc9b47ea9] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:36.402983 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-205e5ec0-2a6a-4096-9b48-bf28c3b46349 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:36.403477 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-205e5ec0-2a6a-4096-9b48-bf28c3b46349 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:36.404748 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-205e5ec0-2a6a-4096-9b48-bf28c3b46349 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:36.405508 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-205e5ec0-2a6a-4096-9b48-bf28c3b46349 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:36.406002 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-205e5ec0-2a6a-4096-9b48-bf28c3b46349 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:36.406436 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-205e5ec0-2a6a-4096-9b48-bf28c3b46349 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:36.520633 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-205e5ec0-2a6a-4096-9b48-bf28c3b46349 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:36.531062 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-9f41abb4-3a5d-42a7-a8ed-765e99cd8f32 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:36.531890 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-9f41abb4-3a5d-42a7-a8ed-765e99cd8f32 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:36.555229 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-205e5ec0-2a6a-4096-9b48-bf28c3b46349 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9" status: 200 len: 1311 microversion: 2.1 time: 0.163382 Sep 01 14:13:36.556516 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 494/995] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:36 2022] GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9 => generated 1311 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:36.569933 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9f41abb4-3a5d-42a7-a8ed-765e99cd8f32 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:36.574543 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9f41abb4-3a5d-42a7-a8ed-765e99cd8f32 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:36.576109 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9f41abb4-3a5d-42a7-a8ed-765e99cd8f32 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:36.582629 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9f41abb4-3a5d-42a7-a8ed-765e99cd8f32 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:36.585022 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9f41abb4-3a5d-42a7-a8ed-765e99cd8f32 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:36.588018 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9f41abb4-3a5d-42a7-a8ed-765e99cd8f32 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:36.671337 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-325baafc-6e0a-4136-9b36-bd3834a10bdc tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:36.672422 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-325baafc-6e0a-4136-9b36-bd3834a10bdc tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: e221a685-4333-48cb-ab94-67a4c0402490] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:36.680593 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-325baafc-6e0a-4136-9b36-bd3834a10bdc tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:36.681442 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-325baafc-6e0a-4136-9b36-bd3834a10bdc tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:36.682136 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-325baafc-6e0a-4136-9b36-bd3834a10bdc tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:36.683479 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-325baafc-6e0a-4136-9b36-bd3834a10bdc tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:36.685007 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-325baafc-6e0a-4136-9b36-bd3834a10bdc tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:36.685711 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-325baafc-6e0a-4136-9b36-bd3834a10bdc tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:36.968072 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-325baafc-6e0a-4136-9b36-bd3834a10bdc tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:36.992304 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-325baafc-6e0a-4136-9b36-bd3834a10bdc tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490" status: 200 len: 1193 microversion: 2.1 time: 0.326088 Sep 01 14:13:36.994736 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 495/996] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:36 2022] GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490 => generated 1193 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:13:37.262542 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-9f41abb4-3a5d-42a7-a8ed-765e99cd8f32 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:37.287451 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-9f41abb4-3a5d-42a7-a8ed-765e99cd8f32 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:37.290371 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-9f41abb4-3a5d-42a7-a8ed-765e99cd8f32 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:37.292928 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-9f41abb4-3a5d-42a7-a8ed-765e99cd8f32 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1729 microversion: 2.20 time: 0.767190 Sep 01 14:13:37.298976 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 502/997] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:13:36 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1729 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:13:37.578818 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-24900273-a44b-43ea-81e5-216afec1c3f5 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:37.579554 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-24900273-a44b-43ea-81e5-216afec1c3f5 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: f21e2730-924a-436f-a04b-ce7bc9b47ea9] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:37.596540 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-24900273-a44b-43ea-81e5-216afec1c3f5 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:37.597042 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-24900273-a44b-43ea-81e5-216afec1c3f5 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:37.597486 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-24900273-a44b-43ea-81e5-216afec1c3f5 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:37.616265 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-24900273-a44b-43ea-81e5-216afec1c3f5 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:37.616265 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-24900273-a44b-43ea-81e5-216afec1c3f5 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:37.616265 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-24900273-a44b-43ea-81e5-216afec1c3f5 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:37.800371 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-24900273-a44b-43ea-81e5-216afec1c3f5 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:37.814036 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-24900273-a44b-43ea-81e5-216afec1c3f5 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9" status: 200 len: 1299 microversion: 2.1 time: 0.235637 Sep 01 14:13:37.814897 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 496/998] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:37 2022] GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9 => generated 1299 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:13:38.030421 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-fb527c2d-a52c-4097-9afd-a9da7889f563 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:38.031296 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-fb527c2d-a52c-4097-9afd-a9da7889f563 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: e221a685-4333-48cb-ab94-67a4c0402490] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:38.059627 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-fb527c2d-a52c-4097-9afd-a9da7889f563 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:38.061108 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-fb527c2d-a52c-4097-9afd-a9da7889f563 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:38.061925 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-fb527c2d-a52c-4097-9afd-a9da7889f563 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:38.063641 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-fb527c2d-a52c-4097-9afd-a9da7889f563 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:38.065331 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-fb527c2d-a52c-4097-9afd-a9da7889f563 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:38.066180 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-fb527c2d-a52c-4097-9afd-a9da7889f563 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:38.268237 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-fb527c2d-a52c-4097-9afd-a9da7889f563 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:38.274642 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell1:SELECT=100 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:13:38.294737 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-fb527c2d-a52c-4097-9afd-a9da7889f563 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490" status: 200 len: 1211 microversion: 2.1 time: 0.267061 Sep 01 14:13:38.298502 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 503/999] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:38 2022] GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490 => generated 1211 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:13:38.323865 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-eda36ff5-437f-4e9b-8061-2b590e7a526d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:38.325890 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-eda36ff5-437f-4e9b-8061-2b590e7a526d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:38.335322 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-eda36ff5-437f-4e9b-8061-2b590e7a526d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:38.335962 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-eda36ff5-437f-4e9b-8061-2b590e7a526d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:38.336508 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-eda36ff5-437f-4e9b-8061-2b590e7a526d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:38.337533 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-eda36ff5-437f-4e9b-8061-2b590e7a526d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:38.339107 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-eda36ff5-437f-4e9b-8061-2b590e7a526d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:38.339542 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-eda36ff5-437f-4e9b-8061-2b590e7a526d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:38.593939 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-eda36ff5-437f-4e9b-8061-2b590e7a526d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:38.612932 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-eda36ff5-437f-4e9b-8061-2b590e7a526d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:38.617142 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-eda36ff5-437f-4e9b-8061-2b590e7a526d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:38.619015 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-eda36ff5-437f-4e9b-8061-2b590e7a526d tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1729 microversion: 2.20 time: 0.305188 Sep 01 14:13:38.619702 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 497/1000] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:13:38 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1729 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:13:38.856356 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-5fb5fcd2-30cc-4108-b180-3fc57f78dc53 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:38.858562 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-5fb5fcd2-30cc-4108-b180-3fc57f78dc53 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: f21e2730-924a-436f-a04b-ce7bc9b47ea9] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:38.868226 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5fb5fcd2-30cc-4108-b180-3fc57f78dc53 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:38.868980 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5fb5fcd2-30cc-4108-b180-3fc57f78dc53 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:38.869527 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5fb5fcd2-30cc-4108-b180-3fc57f78dc53 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:38.870490 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5fb5fcd2-30cc-4108-b180-3fc57f78dc53 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:38.871057 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5fb5fcd2-30cc-4108-b180-3fc57f78dc53 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:38.871629 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5fb5fcd2-30cc-4108-b180-3fc57f78dc53 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:38.948751 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-5fb5fcd2-30cc-4108-b180-3fc57f78dc53 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:38.957825 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-5fb5fcd2-30cc-4108-b180-3fc57f78dc53 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9" status: 200 len: 1299 microversion: 2.1 time: 0.108984 Sep 01 14:13:38.958488 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 504/1001] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:38 2022] GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9 => generated 1299 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:39.003473 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [req-eb112230-291c-4c06-b0ac-e2a64b102c4f req-390d648c-e767-464e-aec5-35d33cb62a73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1", "name": "network-vif-plugged", "status": "completed", "tag": "214b6ab8-206c-4129-a639-f69abbdaa49b"}]} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:13:39.016595 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-eb112230-291c-4c06-b0ac-e2a64b102c4f req-390d648c-e767-464e-aec5-35d33cb62a73 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:39.017082 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-eb112230-291c-4c06-b0ac-e2a64b102c4f req-390d648c-e767-464e-aec5-35d33cb62a73 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:39.017521 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-eb112230-291c-4c06-b0ac-e2a64b102c4f req-390d648c-e767-464e-aec5-35d33cb62a73 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:39.030158 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.compute.server_external_events [req-eb112230-291c-4c06-b0ac-e2a64b102c4f req-390d648c-e767-464e-aec5-35d33cb62a73 service nova] Creating event network-vif-plugged:214b6ab8-206c-4129-a639-f69abbdaa49b for instance d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 on hv-cinder-85221 Sep 01 14:13:39.036257 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [req-eb112230-291c-4c06-b0ac-e2a64b102c4f req-390d648c-e767-464e-aec5-35d33cb62a73 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037277 Sep 01 14:13:39.037056 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 498/1002] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:13:39.325369 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-177d0655-e2c4-456b-9ce3-e3ca31af8999 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:39.329283 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-177d0655-e2c4-456b-9ce3-e3ca31af8999 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: e221a685-4333-48cb-ab94-67a4c0402490] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:39.338717 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-177d0655-e2c4-456b-9ce3-e3ca31af8999 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:39.339804 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-177d0655-e2c4-456b-9ce3-e3ca31af8999 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:39.340611 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-177d0655-e2c4-456b-9ce3-e3ca31af8999 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:39.342676 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-177d0655-e2c4-456b-9ce3-e3ca31af8999 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:39.343648 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-177d0655-e2c4-456b-9ce3-e3ca31af8999 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:39.344448 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-177d0655-e2c4-456b-9ce3-e3ca31af8999 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:39.424885 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-177d0655-e2c4-456b-9ce3-e3ca31af8999 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:39.438196 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-177d0655-e2c4-456b-9ce3-e3ca31af8999 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490" status: 200 len: 1211 microversion: 2.1 time: 0.119604 Sep 01 14:13:39.439353 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 505/1003] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:39 2022] GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490 => generated 1211 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:39.651794 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-df71f8b3-8582-4960-a666-b3fe0766d911 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:39.653243 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-df71f8b3-8582-4960-a666-b3fe0766d911 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:39.672125 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-df71f8b3-8582-4960-a666-b3fe0766d911 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:39.673039 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-df71f8b3-8582-4960-a666-b3fe0766d911 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:39.674439 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-df71f8b3-8582-4960-a666-b3fe0766d911 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:39.675644 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-df71f8b3-8582-4960-a666-b3fe0766d911 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:39.677790 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-df71f8b3-8582-4960-a666-b3fe0766d911 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:39.680706 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-df71f8b3-8582-4960-a666-b3fe0766d911 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:39.982549 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-c8c89d99-1206-4618-9209-396c64ea4113 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:39.986256 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-c8c89d99-1206-4618-9209-396c64ea4113 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: f21e2730-924a-436f-a04b-ce7bc9b47ea9] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:39.997039 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c8c89d99-1206-4618-9209-396c64ea4113 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:39.998442 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c8c89d99-1206-4618-9209-396c64ea4113 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:39.999053 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c8c89d99-1206-4618-9209-396c64ea4113 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:40.000362 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c8c89d99-1206-4618-9209-396c64ea4113 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:40.001127 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c8c89d99-1206-4618-9209-396c64ea4113 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:40.001688 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c8c89d99-1206-4618-9209-396c64ea4113 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:40.192714 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-df71f8b3-8582-4960-a666-b3fe0766d911 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:40.205004 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-df71f8b3-8582-4960-a666-b3fe0766d911 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:40.207189 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-df71f8b3-8582-4960-a666-b3fe0766d911 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:40.208660 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-df71f8b3-8582-4960-a666-b3fe0766d911 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1729 microversion: 2.20 time: 0.563025 Sep 01 14:13:40.226327 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 499/1004] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:13:39 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1729 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:13:40.468864 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-c8c89d99-1206-4618-9209-396c64ea4113 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:40.477007 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-793d98bc-277c-4bc0-b667-a3c61a27f652 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:40.478081 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-793d98bc-277c-4bc0-b667-a3c61a27f652 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: e221a685-4333-48cb-ab94-67a4c0402490] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:40.494892 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-c8c89d99-1206-4618-9209-396c64ea4113 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9" status: 200 len: 1366 microversion: 2.1 time: 0.518550 Sep 01 14:13:40.498777 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 506/1005] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:39 2022] GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9 => generated 1366 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:13:40.504212 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-793d98bc-277c-4bc0-b667-a3c61a27f652 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:40.504700 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-793d98bc-277c-4bc0-b667-a3c61a27f652 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:40.505278 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-793d98bc-277c-4bc0-b667-a3c61a27f652 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:40.506413 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-793d98bc-277c-4bc0-b667-a3c61a27f652 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:40.506885 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-793d98bc-277c-4bc0-b667-a3c61a27f652 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:40.507303 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-793d98bc-277c-4bc0-b667-a3c61a27f652 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:40.830799 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-793d98bc-277c-4bc0-b667-a3c61a27f652 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:40.848990 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-793d98bc-277c-4bc0-b667-a3c61a27f652 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490" status: 200 len: 1266 microversion: 2.1 time: 0.390370 Sep 01 14:13:40.851490 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 500/1006] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:40 2022] GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490 => generated 1266 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:13:41.233682 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [req-587edc1d-8781-41ca-a1a0-d6981584b4eb req-d02b3730-e5bb-43e5-8708-824f550bac67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f21e2730-924a-436f-a04b-ce7bc9b47ea9", "tag": "21f0cea4-2894-4114-a667-cf4f7590ef92"}]} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:13:41.235495 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-7b9ad596-97e3-4f22-9578-ea1395e2bdf8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:41.236339 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-7b9ad596-97e3-4f22-9578-ea1395e2bdf8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:41.248878 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7b9ad596-97e3-4f22-9578-ea1395e2bdf8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:41.251487 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7b9ad596-97e3-4f22-9578-ea1395e2bdf8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:41.253512 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7b9ad596-97e3-4f22-9578-ea1395e2bdf8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:41.254907 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7b9ad596-97e3-4f22-9578-ea1395e2bdf8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:41.255794 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7b9ad596-97e3-4f22-9578-ea1395e2bdf8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:41.258516 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7b9ad596-97e3-4f22-9578-ea1395e2bdf8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:41.276177 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-587edc1d-8781-41ca-a1a0-d6981584b4eb req-d02b3730-e5bb-43e5-8708-824f550bac67 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:41.279212 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-587edc1d-8781-41ca-a1a0-d6981584b4eb req-d02b3730-e5bb-43e5-8708-824f550bac67 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:41.281977 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-587edc1d-8781-41ca-a1a0-d6981584b4eb req-d02b3730-e5bb-43e5-8708-824f550bac67 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:41.322932 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.compute.server_external_events [req-587edc1d-8781-41ca-a1a0-d6981584b4eb req-d02b3730-e5bb-43e5-8708-824f550bac67 service nova] Creating event network-changed:21f0cea4-2894-4114-a667-cf4f7590ef92 for instance f21e2730-924a-436f-a04b-ce7bc9b47ea9 on hv-cinder-85221 Sep 01 14:13:41.333028 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [req-587edc1d-8781-41ca-a1a0-d6981584b4eb req-d02b3730-e5bb-43e5-8708-824f550bac67 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115302 Sep 01 14:13:41.334980 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 507/1007] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:13:41.532629 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-4d2c8442-9609-45cd-b612-ba20286d48ea tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:41.539045 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-4d2c8442-9609-45cd-b612-ba20286d48ea tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: f21e2730-924a-436f-a04b-ce7bc9b47ea9] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:41.557103 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4d2c8442-9609-45cd-b612-ba20286d48ea tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:41.559502 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4d2c8442-9609-45cd-b612-ba20286d48ea tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:41.560817 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4d2c8442-9609-45cd-b612-ba20286d48ea tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:41.563410 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4d2c8442-9609-45cd-b612-ba20286d48ea tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:41.564809 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4d2c8442-9609-45cd-b612-ba20286d48ea tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:41.566034 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4d2c8442-9609-45cd-b612-ba20286d48ea tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:41.608325 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-7b9ad596-97e3-4f22-9578-ea1395e2bdf8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:41.628252 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-7b9ad596-97e3-4f22-9578-ea1395e2bdf8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:41.634190 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-7b9ad596-97e3-4f22-9578-ea1395e2bdf8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:41.641139 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-7b9ad596-97e3-4f22-9578-ea1395e2bdf8 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1729 microversion: 2.20 time: 0.410359 Sep 01 14:13:41.643912 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 501/1008] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:13:41 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1729 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:13:41.679134 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [req-d608c03d-e810-407f-9eed-e22c45c5a4b6 req-2d219054-c1a0-45fd-b5fd-215b69d5ac0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e221a685-4333-48cb-ab94-67a4c0402490", "tag": "96452891-5521-419c-9c6f-b16dbf8fef1e"}]} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:13:41.706193 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-d608c03d-e810-407f-9eed-e22c45c5a4b6 req-2d219054-c1a0-45fd-b5fd-215b69d5ac0c service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:41.708040 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-d608c03d-e810-407f-9eed-e22c45c5a4b6 req-2d219054-c1a0-45fd-b5fd-215b69d5ac0c service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:41.709571 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-d608c03d-e810-407f-9eed-e22c45c5a4b6 req-2d219054-c1a0-45fd-b5fd-215b69d5ac0c service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:41.740195 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.compute.server_external_events [req-d608c03d-e810-407f-9eed-e22c45c5a4b6 req-2d219054-c1a0-45fd-b5fd-215b69d5ac0c service nova] Creating event network-changed:96452891-5521-419c-9c6f-b16dbf8fef1e for instance e221a685-4333-48cb-ab94-67a4c0402490 on hv-cinder-85221 Sep 01 14:13:41.758097 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [req-d608c03d-e810-407f-9eed-e22c45c5a4b6 req-2d219054-c1a0-45fd-b5fd-215b69d5ac0c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080622 Sep 01 14:13:41.760122 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 502/1009] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:13:41.895020 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-499c1baf-3e1f-4418-a909-525d15b2a560 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:41.902346 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-499c1baf-3e1f-4418-a909-525d15b2a560 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: e221a685-4333-48cb-ab94-67a4c0402490] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:41.933462 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-499c1baf-3e1f-4418-a909-525d15b2a560 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:41.938426 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-499c1baf-3e1f-4418-a909-525d15b2a560 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:41.940221 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-499c1baf-3e1f-4418-a909-525d15b2a560 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:41.943936 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-499c1baf-3e1f-4418-a909-525d15b2a560 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:41.945262 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-499c1baf-3e1f-4418-a909-525d15b2a560 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:41.950825 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-499c1baf-3e1f-4418-a909-525d15b2a560 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:42.266264 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-4d2c8442-9609-45cd-b612-ba20286d48ea tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:42.275015 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-4d2c8442-9609-45cd-b612-ba20286d48ea tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9" status: 200 len: 1366 microversion: 2.1 time: 0.757375 Sep 01 14:13:42.276399 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 508/1010] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:41 2022] GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9 => generated 1366 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:13:42.495017 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-499c1baf-3e1f-4418-a909-525d15b2a560 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:42.504607 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-499c1baf-3e1f-4418-a909-525d15b2a560 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490" status: 200 len: 1266 microversion: 2.1 time: 0.619783 Sep 01 14:13:42.505204 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 503/1011] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:41 2022] GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490 => generated 1266 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:13:42.664746 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-14acb90e-63fa-400b-94a3-fd27f2c86848 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:42.665430 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-14acb90e-63fa-400b-94a3-fd27f2c86848 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:42.681045 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-14acb90e-63fa-400b-94a3-fd27f2c86848 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:42.681045 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-14acb90e-63fa-400b-94a3-fd27f2c86848 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:42.681045 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-14acb90e-63fa-400b-94a3-fd27f2c86848 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:42.681045 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-14acb90e-63fa-400b-94a3-fd27f2c86848 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:42.681645 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-14acb90e-63fa-400b-94a3-fd27f2c86848 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:42.681645 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-14acb90e-63fa-400b-94a3-fd27f2c86848 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:42.911951 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-14acb90e-63fa-400b-94a3-fd27f2c86848 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:42.921545 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-14acb90e-63fa-400b-94a3-fd27f2c86848 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:42.923080 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-14acb90e-63fa-400b-94a3-fd27f2c86848 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:42.924537 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-14acb90e-63fa-400b-94a3-fd27f2c86848 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1729 microversion: 2.20 time: 0.263858 Sep 01 14:13:42.938143 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 509/1012] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:13:42 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1729 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:13:43.299739 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-f0f7587f-abfb-4b8a-9b2d-bcd073d286c0 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:43.300609 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-f0f7587f-abfb-4b8a-9b2d-bcd073d286c0 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: f21e2730-924a-436f-a04b-ce7bc9b47ea9] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:43.307435 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f0f7587f-abfb-4b8a-9b2d-bcd073d286c0 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:43.308025 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f0f7587f-abfb-4b8a-9b2d-bcd073d286c0 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:43.308474 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f0f7587f-abfb-4b8a-9b2d-bcd073d286c0 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:43.309230 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f0f7587f-abfb-4b8a-9b2d-bcd073d286c0 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:43.309706 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f0f7587f-abfb-4b8a-9b2d-bcd073d286c0 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:43.310195 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f0f7587f-abfb-4b8a-9b2d-bcd073d286c0 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:43.516699 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-f0f7587f-abfb-4b8a-9b2d-bcd073d286c0 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:43.530659 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-f0f7587f-abfb-4b8a-9b2d-bcd073d286c0 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9" status: 200 len: 1366 microversion: 2.1 time: 0.236945 Sep 01 14:13:43.530995 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-663f11de-8ad4-4237-adeb-063e3a7f11b0 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:43.531247 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 504/1013] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:43 2022] GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9 => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:43.541970 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-663f11de-8ad4-4237-adeb-063e3a7f11b0 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: e221a685-4333-48cb-ab94-67a4c0402490] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:43.541970 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-663f11de-8ad4-4237-adeb-063e3a7f11b0 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:43.541970 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-663f11de-8ad4-4237-adeb-063e3a7f11b0 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:43.541970 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-663f11de-8ad4-4237-adeb-063e3a7f11b0 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:43.542882 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-663f11de-8ad4-4237-adeb-063e3a7f11b0 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:43.543615 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-663f11de-8ad4-4237-adeb-063e3a7f11b0 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:43.544635 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-663f11de-8ad4-4237-adeb-063e3a7f11b0 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:43.818322 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-663f11de-8ad4-4237-adeb-063e3a7f11b0 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:43.838404 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-663f11de-8ad4-4237-adeb-063e3a7f11b0 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490" status: 200 len: 1266 microversion: 2.1 time: 0.313647 Sep 01 14:13:43.840150 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 510/1014] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:43 2022] GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490 => generated 1266 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:43.952426 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-131fba55-efae-4cf7-a041-ab39025dc940 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:43.957246 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-131fba55-efae-4cf7-a041-ab39025dc940 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:43.963717 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-131fba55-efae-4cf7-a041-ab39025dc940 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:43.964590 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-131fba55-efae-4cf7-a041-ab39025dc940 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:43.965662 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-131fba55-efae-4cf7-a041-ab39025dc940 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:43.967529 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-131fba55-efae-4cf7-a041-ab39025dc940 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:43.968398 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-131fba55-efae-4cf7-a041-ab39025dc940 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:43.969171 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-131fba55-efae-4cf7-a041-ab39025dc940 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:44.253806 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-131fba55-efae-4cf7-a041-ab39025dc940 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:44.290945 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-131fba55-efae-4cf7-a041-ab39025dc940 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:44.295078 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-131fba55-efae-4cf7-a041-ab39025dc940 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:44.297580 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-131fba55-efae-4cf7-a041-ab39025dc940 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1729 microversion: 2.20 time: 0.351666 Sep 01 14:13:44.313941 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 505/1015] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:13:43 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1729 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:13:44.554195 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-d9c42a20-0c6c-4a55-9c35-9e99d3aed3a0 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:44.554903 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-d9c42a20-0c6c-4a55-9c35-9e99d3aed3a0 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: f21e2730-924a-436f-a04b-ce7bc9b47ea9] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:44.563089 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d9c42a20-0c6c-4a55-9c35-9e99d3aed3a0 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:44.564342 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d9c42a20-0c6c-4a55-9c35-9e99d3aed3a0 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:44.565059 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d9c42a20-0c6c-4a55-9c35-9e99d3aed3a0 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:44.566343 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d9c42a20-0c6c-4a55-9c35-9e99d3aed3a0 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:44.567697 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d9c42a20-0c6c-4a55-9c35-9e99d3aed3a0 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:44.568424 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d9c42a20-0c6c-4a55-9c35-9e99d3aed3a0 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:44.871056 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-94b7a337-c30c-4fff-a36f-61d5e5cc14ac tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:44.872526 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-94b7a337-c30c-4fff-a36f-61d5e5cc14ac tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: e221a685-4333-48cb-ab94-67a4c0402490] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:44.882682 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-94b7a337-c30c-4fff-a36f-61d5e5cc14ac tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:44.882682 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-94b7a337-c30c-4fff-a36f-61d5e5cc14ac tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:44.882682 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-94b7a337-c30c-4fff-a36f-61d5e5cc14ac tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:44.883132 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-94b7a337-c30c-4fff-a36f-61d5e5cc14ac tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:44.883656 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-94b7a337-c30c-4fff-a36f-61d5e5cc14ac tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:44.884093 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-94b7a337-c30c-4fff-a36f-61d5e5cc14ac tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:44.885974 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-d9c42a20-0c6c-4a55-9c35-9e99d3aed3a0 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:44.913137 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-d9c42a20-0c6c-4a55-9c35-9e99d3aed3a0 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9" status: 200 len: 1366 microversion: 2.1 time: 0.362676 Sep 01 14:13:44.918494 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 511/1016] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:44 2022] GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9 => generated 1366 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:13:45.154418 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-94b7a337-c30c-4fff-a36f-61d5e5cc14ac tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:45.168210 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-94b7a337-c30c-4fff-a36f-61d5e5cc14ac tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490" status: 200 len: 1266 microversion: 2.1 time: 0.301574 Sep 01 14:13:45.170077 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 506/1017] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:44 2022] GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490 => generated 1266 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:13:45.350356 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-3c7038f2-e7ef-4233-b387-aa39d61af94b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:45.350978 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-3c7038f2-e7ef-4233-b387-aa39d61af94b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:45.361382 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3c7038f2-e7ef-4233-b387-aa39d61af94b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:45.362218 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3c7038f2-e7ef-4233-b387-aa39d61af94b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:45.362938 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3c7038f2-e7ef-4233-b387-aa39d61af94b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:45.364282 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3c7038f2-e7ef-4233-b387-aa39d61af94b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:45.365142 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3c7038f2-e7ef-4233-b387-aa39d61af94b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:45.365770 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3c7038f2-e7ef-4233-b387-aa39d61af94b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:45.564387 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-3c7038f2-e7ef-4233-b387-aa39d61af94b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:45.597934 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-3c7038f2-e7ef-4233-b387-aa39d61af94b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:45.605242 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-3c7038f2-e7ef-4233-b387-aa39d61af94b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:45.608536 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-3c7038f2-e7ef-4233-b387-aa39d61af94b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1716 microversion: 2.20 time: 0.262161 Sep 01 14:13:45.610298 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 512/1018] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:13:45 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1716 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:13:45.940466 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-22ee3b5c-d2b6-4a9d-b538-88d90ac0e528 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:45.941396 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-22ee3b5c-d2b6-4a9d-b538-88d90ac0e528 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: f21e2730-924a-436f-a04b-ce7bc9b47ea9] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:45.947928 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-22ee3b5c-d2b6-4a9d-b538-88d90ac0e528 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:45.948422 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-22ee3b5c-d2b6-4a9d-b538-88d90ac0e528 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:45.948857 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-22ee3b5c-d2b6-4a9d-b538-88d90ac0e528 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:45.949558 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-22ee3b5c-d2b6-4a9d-b538-88d90ac0e528 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:45.950044 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-22ee3b5c-d2b6-4a9d-b538-88d90ac0e528 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:45.951064 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-22ee3b5c-d2b6-4a9d-b538-88d90ac0e528 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:46.096020 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-22ee3b5c-d2b6-4a9d-b538-88d90ac0e528 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:46.104643 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-22ee3b5c-d2b6-4a9d-b538-88d90ac0e528 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9" status: 200 len: 1366 microversion: 2.1 time: 0.167997 Sep 01 14:13:46.108970 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 507/1019] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:45 2022] GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:13:46.202579 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-f3dc6978-cd17-4621-8fdb-9220b0704ce8 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:46.207002 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-f3dc6978-cd17-4621-8fdb-9220b0704ce8 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: e221a685-4333-48cb-ab94-67a4c0402490] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:46.214732 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f3dc6978-cd17-4621-8fdb-9220b0704ce8 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:46.215508 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f3dc6978-cd17-4621-8fdb-9220b0704ce8 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:46.216294 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f3dc6978-cd17-4621-8fdb-9220b0704ce8 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:46.217385 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f3dc6978-cd17-4621-8fdb-9220b0704ce8 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:46.218496 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f3dc6978-cd17-4621-8fdb-9220b0704ce8 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:46.219971 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f3dc6978-cd17-4621-8fdb-9220b0704ce8 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:46.433892 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-f3dc6978-cd17-4621-8fdb-9220b0704ce8 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:46.443607 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-f3dc6978-cd17-4621-8fdb-9220b0704ce8 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490" status: 200 len: 1266 microversion: 2.1 time: 0.248996 Sep 01 14:13:46.444568 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 513/1020] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:46 2022] GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490 => generated 1266 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:47.130600 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-9c286578-8862-4098-9836-7b86ddbbf99d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:47.131251 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-9c286578-8862-4098-9836-7b86ddbbf99d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: f21e2730-924a-436f-a04b-ce7bc9b47ea9] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:47.139476 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9c286578-8862-4098-9836-7b86ddbbf99d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:47.142846 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9c286578-8862-4098-9836-7b86ddbbf99d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:47.142846 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9c286578-8862-4098-9836-7b86ddbbf99d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:47.142846 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9c286578-8862-4098-9836-7b86ddbbf99d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:47.142846 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9c286578-8862-4098-9836-7b86ddbbf99d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:47.143272 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9c286578-8862-4098-9836-7b86ddbbf99d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:47.160646 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell1:SELECT=100 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:13:47.234386 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [req-a1397bc6-bea2-49da-9fff-c8dde3bdf955 req-7123960d-916e-4e4a-9e01-4249c07af03f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f21e2730-924a-436f-a04b-ce7bc9b47ea9", "name": "network-vif-plugged", "status": "completed", "tag": "21f0cea4-2894-4114-a667-cf4f7590ef92"}]} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:13:47.256415 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-a1397bc6-bea2-49da-9fff-c8dde3bdf955 req-7123960d-916e-4e4a-9e01-4249c07af03f service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:47.257980 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-a1397bc6-bea2-49da-9fff-c8dde3bdf955 req-7123960d-916e-4e4a-9e01-4249c07af03f service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:47.258860 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-a1397bc6-bea2-49da-9fff-c8dde3bdf955 req-7123960d-916e-4e4a-9e01-4249c07af03f service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:47.282692 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.compute.server_external_events [req-a1397bc6-bea2-49da-9fff-c8dde3bdf955 req-7123960d-916e-4e4a-9e01-4249c07af03f service nova] Creating event network-vif-plugged:21f0cea4-2894-4114-a667-cf4f7590ef92 for instance f21e2730-924a-436f-a04b-ce7bc9b47ea9 on hv-cinder-85221 Sep 01 14:13:47.291489 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [req-a1397bc6-bea2-49da-9fff-c8dde3bdf955 req-7123960d-916e-4e4a-9e01-4249c07af03f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065244 Sep 01 14:13:47.292591 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 514/1021] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:13:47.384767 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-9c286578-8862-4098-9836-7b86ddbbf99d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:47.402674 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-9c286578-8862-4098-9836-7b86ddbbf99d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9" status: 200 len: 1366 microversion: 2.1 time: 0.276119 Sep 01 14:13:47.418496 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 508/1022] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:47 2022] GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9 => generated 1366 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:47.472480 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-5575d326-0342-4cd1-95d7-e497d7f144b6 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:47.473796 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-5575d326-0342-4cd1-95d7-e497d7f144b6 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: e221a685-4333-48cb-ab94-67a4c0402490] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:47.484985 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5575d326-0342-4cd1-95d7-e497d7f144b6 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:47.485870 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5575d326-0342-4cd1-95d7-e497d7f144b6 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:47.486988 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5575d326-0342-4cd1-95d7-e497d7f144b6 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:47.488282 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5575d326-0342-4cd1-95d7-e497d7f144b6 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:47.489129 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5575d326-0342-4cd1-95d7-e497d7f144b6 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:47.492274 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5575d326-0342-4cd1-95d7-e497d7f144b6 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:47.656221 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-5575d326-0342-4cd1-95d7-e497d7f144b6 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:47.671589 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-5575d326-0342-4cd1-95d7-e497d7f144b6 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490" status: 200 len: 1266 microversion: 2.1 time: 0.206305 Sep 01 14:13:47.672414 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 515/1023] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:47 2022] GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490 => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:48.426052 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-156cad69-2aec-4c88-bb81-111d7752e916 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:48.427010 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-156cad69-2aec-4c88-bb81-111d7752e916 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: f21e2730-924a-436f-a04b-ce7bc9b47ea9] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:48.435119 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-156cad69-2aec-4c88-bb81-111d7752e916 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:48.435631 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-156cad69-2aec-4c88-bb81-111d7752e916 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:48.436297 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-156cad69-2aec-4c88-bb81-111d7752e916 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:48.437152 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-156cad69-2aec-4c88-bb81-111d7752e916 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:48.437764 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-156cad69-2aec-4c88-bb81-111d7752e916 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:48.438293 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-156cad69-2aec-4c88-bb81-111d7752e916 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:48.600471 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-156cad69-2aec-4c88-bb81-111d7752e916 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:48.609998 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-156cad69-2aec-4c88-bb81-111d7752e916 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9" status: 200 len: 1366 microversion: 2.1 time: 0.188724 Sep 01 14:13:48.610866 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 509/1024] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:48 2022] GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9 => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:48.709320 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-c219dca5-74da-4415-8bd2-4838c98a264b tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:48.710572 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-c219dca5-74da-4415-8bd2-4838c98a264b tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: e221a685-4333-48cb-ab94-67a4c0402490] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:48.724998 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c219dca5-74da-4415-8bd2-4838c98a264b tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:48.726007 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c219dca5-74da-4415-8bd2-4838c98a264b tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:48.726701 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c219dca5-74da-4415-8bd2-4838c98a264b tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:48.727789 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c219dca5-74da-4415-8bd2-4838c98a264b tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:48.729057 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c219dca5-74da-4415-8bd2-4838c98a264b tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:48.729823 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c219dca5-74da-4415-8bd2-4838c98a264b tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:48.948434 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-c219dca5-74da-4415-8bd2-4838c98a264b tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:48.958609 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-c219dca5-74da-4415-8bd2-4838c98a264b tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490" status: 200 len: 1266 microversion: 2.1 time: 0.263741 Sep 01 14:13:48.959371 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 516/1025] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:48 2022] GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490 => generated 1266 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:49.642285 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-578746a4-1a2b-4626-9211-68836f10087b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:49.643886 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-578746a4-1a2b-4626-9211-68836f10087b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: f21e2730-924a-436f-a04b-ce7bc9b47ea9] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:49.664606 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-578746a4-1a2b-4626-9211-68836f10087b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:49.664606 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-578746a4-1a2b-4626-9211-68836f10087b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:49.664606 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-578746a4-1a2b-4626-9211-68836f10087b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:49.664606 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-578746a4-1a2b-4626-9211-68836f10087b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:49.665620 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-578746a4-1a2b-4626-9211-68836f10087b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:49.665620 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-578746a4-1a2b-4626-9211-68836f10087b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:49.895478 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-578746a4-1a2b-4626-9211-68836f10087b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:49.907956 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-578746a4-1a2b-4626-9211-68836f10087b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9" status: 200 len: 1366 microversion: 2.1 time: 0.276727 Sep 01 14:13:49.908931 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 510/1026] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:49 2022] GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9 => generated 1366 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:49.980520 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-3cdd5e43-de26-43bd-8d5c-eb5c94fd3eb2 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:49.981303 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-3cdd5e43-de26-43bd-8d5c-eb5c94fd3eb2 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: e221a685-4333-48cb-ab94-67a4c0402490] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:49.988493 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3cdd5e43-de26-43bd-8d5c-eb5c94fd3eb2 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:49.989027 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3cdd5e43-de26-43bd-8d5c-eb5c94fd3eb2 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:49.989463 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3cdd5e43-de26-43bd-8d5c-eb5c94fd3eb2 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:49.990209 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3cdd5e43-de26-43bd-8d5c-eb5c94fd3eb2 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:49.990661 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3cdd5e43-de26-43bd-8d5c-eb5c94fd3eb2 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:49.991078 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-3cdd5e43-de26-43bd-8d5c-eb5c94fd3eb2 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:50.174522 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-3cdd5e43-de26-43bd-8d5c-eb5c94fd3eb2 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:50.183573 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-3cdd5e43-de26-43bd-8d5c-eb5c94fd3eb2 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490" status: 200 len: 1266 microversion: 2.1 time: 0.206976 Sep 01 14:13:50.184170 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 517/1027] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:49 2022] GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490 => generated 1266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:50.934945 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-51a47d58-76a7-49ee-89e2-df8ba132226c tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:50.936005 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-51a47d58-76a7-49ee-89e2-df8ba132226c tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: f21e2730-924a-436f-a04b-ce7bc9b47ea9] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:50.944834 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-51a47d58-76a7-49ee-89e2-df8ba132226c tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:50.945497 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-51a47d58-76a7-49ee-89e2-df8ba132226c tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:50.952817 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-51a47d58-76a7-49ee-89e2-df8ba132226c tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:50.952817 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-51a47d58-76a7-49ee-89e2-df8ba132226c tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:50.952817 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-51a47d58-76a7-49ee-89e2-df8ba132226c tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:50.952817 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-51a47d58-76a7-49ee-89e2-df8ba132226c tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:51.104951 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-51a47d58-76a7-49ee-89e2-df8ba132226c tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:51.114228 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-51a47d58-76a7-49ee-89e2-df8ba132226c tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9" status: 200 len: 1556 microversion: 2.1 time: 0.184881 Sep 01 14:13:51.117387 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 511/1028] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:50 2022] GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9 => generated 1556 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:51.141667 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-e80ce11a-52ea-4d53-8546-70d431508f03 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:51.143232 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-e80ce11a-52ea-4d53-8546-70d431508f03 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: f21e2730-924a-436f-a04b-ce7bc9b47ea9] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:51.146234 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:13:51.151815 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e80ce11a-52ea-4d53-8546-70d431508f03 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:51.152316 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e80ce11a-52ea-4d53-8546-70d431508f03 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:51.152767 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e80ce11a-52ea-4d53-8546-70d431508f03 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:51.153576 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e80ce11a-52ea-4d53-8546-70d431508f03 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:51.154330 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e80ce11a-52ea-4d53-8546-70d431508f03 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:51.155491 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e80ce11a-52ea-4d53-8546-70d431508f03 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:51.214325 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-9481f44c-2823-42ec-a557-774fed4cc764 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:51.216580 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-9481f44c-2823-42ec-a557-774fed4cc764 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: e221a685-4333-48cb-ab94-67a4c0402490] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:51.228987 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9481f44c-2823-42ec-a557-774fed4cc764 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:51.229968 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9481f44c-2823-42ec-a557-774fed4cc764 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:51.231035 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9481f44c-2823-42ec-a557-774fed4cc764 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:51.233116 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9481f44c-2823-42ec-a557-774fed4cc764 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:51.234060 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9481f44c-2823-42ec-a557-774fed4cc764 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:51.235082 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9481f44c-2823-42ec-a557-774fed4cc764 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:51.264798 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-e80ce11a-52ea-4d53-8546-70d431508f03 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.130105 Sep 01 14:13:51.265641 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 518/1029] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Sep 1 14:13:51 2022] GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9/os-interface => generated 284 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:13:51.442160 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-9481f44c-2823-42ec-a557-774fed4cc764 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:51.461781 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-9481f44c-2823-42ec-a557-774fed4cc764 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490" status: 200 len: 1266 microversion: 2.1 time: 0.256221 Sep 01 14:13:51.463185 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 512/1030] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:51 2022] GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490 => generated 1266 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:13:52.486449 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-9e48f4b2-98ab-45ae-b38e-f35794d1dbd8 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:52.487463 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-9e48f4b2-98ab-45ae-b38e-f35794d1dbd8 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: e221a685-4333-48cb-ab94-67a4c0402490] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:52.498333 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9e48f4b2-98ab-45ae-b38e-f35794d1dbd8 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:52.499046 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9e48f4b2-98ab-45ae-b38e-f35794d1dbd8 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:52.499592 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9e48f4b2-98ab-45ae-b38e-f35794d1dbd8 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:52.500513 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9e48f4b2-98ab-45ae-b38e-f35794d1dbd8 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:52.501154 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9e48f4b2-98ab-45ae-b38e-f35794d1dbd8 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:52.501801 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-9e48f4b2-98ab-45ae-b38e-f35794d1dbd8 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:52.769866 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-9e48f4b2-98ab-45ae-b38e-f35794d1dbd8 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:52.781333 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-9e48f4b2-98ab-45ae-b38e-f35794d1dbd8 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490" status: 200 len: 1266 microversion: 2.1 time: 0.301035 Sep 01 14:13:52.788403 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 519/1031] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:52 2022] GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490 => generated 1266 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:13:52.927236 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [req-e91052a5-bf86-47b8-99d3-b9faa36562b6 req-154d734f-2a9a-42ef-9df5-2a4d61758375 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f21e2730-924a-436f-a04b-ce7bc9b47ea9", "tag": "21f0cea4-2894-4114-a667-cf4f7590ef92"}]} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:13:52.950102 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-e91052a5-bf86-47b8-99d3-b9faa36562b6 req-154d734f-2a9a-42ef-9df5-2a4d61758375 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:52.950102 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-e91052a5-bf86-47b8-99d3-b9faa36562b6 req-154d734f-2a9a-42ef-9df5-2a4d61758375 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:52.950669 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-e91052a5-bf86-47b8-99d3-b9faa36562b6 req-154d734f-2a9a-42ef-9df5-2a4d61758375 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:52.973706 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.compute.server_external_events [req-e91052a5-bf86-47b8-99d3-b9faa36562b6 req-154d734f-2a9a-42ef-9df5-2a4d61758375 service nova] Creating event network-changed:21f0cea4-2894-4114-a667-cf4f7590ef92 for instance f21e2730-924a-436f-a04b-ce7bc9b47ea9 on hv-cinder-85221 Sep 01 14:13:52.986593 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [req-e91052a5-bf86-47b8-99d3-b9faa36562b6 req-154d734f-2a9a-42ef-9df5-2a4d61758375 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066993 Sep 01 14:13:52.990141 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 513/1032] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:13:53.282017 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [req-1415c5d5-b31c-4780-a2ba-c907ab1b58c4 req-b9e46eec-c5e4-4fea-ace7-cc1de1aa1968 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e221a685-4333-48cb-ab94-67a4c0402490", "name": "network-vif-plugged", "status": "completed", "tag": "96452891-5521-419c-9c6f-b16dbf8fef1e"}]} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:13:53.315426 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-1415c5d5-b31c-4780-a2ba-c907ab1b58c4 req-b9e46eec-c5e4-4fea-ace7-cc1de1aa1968 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:53.318502 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-1415c5d5-b31c-4780-a2ba-c907ab1b58c4 req-b9e46eec-c5e4-4fea-ace7-cc1de1aa1968 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:53.321949 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-1415c5d5-b31c-4780-a2ba-c907ab1b58c4 req-b9e46eec-c5e4-4fea-ace7-cc1de1aa1968 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:53.339602 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.compute.server_external_events [req-1415c5d5-b31c-4780-a2ba-c907ab1b58c4 req-b9e46eec-c5e4-4fea-ace7-cc1de1aa1968 service nova] Creating event network-vif-plugged:96452891-5521-419c-9c6f-b16dbf8fef1e for instance e221a685-4333-48cb-ab94-67a4c0402490 on hv-cinder-85221 Sep 01 14:13:53.345687 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [req-1415c5d5-b31c-4780-a2ba-c907ab1b58c4 req-b9e46eec-c5e4-4fea-ace7-cc1de1aa1968 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068290 Sep 01 14:13:53.346963 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 520/1033] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:13:53.815915 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-6c7bff2b-7f3a-4cb1-9c5a-0bc4df337e9e tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:53.818802 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-6c7bff2b-7f3a-4cb1-9c5a-0bc4df337e9e tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: e221a685-4333-48cb-ab94-67a4c0402490] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:53.856847 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6c7bff2b-7f3a-4cb1-9c5a-0bc4df337e9e tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:53.865279 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6c7bff2b-7f3a-4cb1-9c5a-0bc4df337e9e tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:53.866669 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6c7bff2b-7f3a-4cb1-9c5a-0bc4df337e9e tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:53.870536 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6c7bff2b-7f3a-4cb1-9c5a-0bc4df337e9e tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:53.878740 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6c7bff2b-7f3a-4cb1-9c5a-0bc4df337e9e tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:53.878740 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6c7bff2b-7f3a-4cb1-9c5a-0bc4df337e9e tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:54.253616 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-6c7bff2b-7f3a-4cb1-9c5a-0bc4df337e9e tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:54.273072 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-6c7bff2b-7f3a-4cb1-9c5a-0bc4df337e9e tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490" status: 200 len: 1266 microversion: 2.1 time: 0.470040 Sep 01 14:13:54.290523 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 514/1034] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:53 2022] GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490 => generated 1266 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:55.305810 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-1769713a-07da-451d-86fa-56fd39b56997 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:55.306602 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-1769713a-07da-451d-86fa-56fd39b56997 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: e221a685-4333-48cb-ab94-67a4c0402490] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:55.313686 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1769713a-07da-451d-86fa-56fd39b56997 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:55.314222 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1769713a-07da-451d-86fa-56fd39b56997 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:55.314764 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1769713a-07da-451d-86fa-56fd39b56997 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:55.315380 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1769713a-07da-451d-86fa-56fd39b56997 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:55.315837 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1769713a-07da-451d-86fa-56fd39b56997 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:55.316262 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1769713a-07da-451d-86fa-56fd39b56997 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:55.521983 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-1769713a-07da-451d-86fa-56fd39b56997 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:55.534504 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-1769713a-07da-451d-86fa-56fd39b56997 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490" status: 200 len: 1266 microversion: 2.1 time: 0.233266 Sep 01 14:13:55.537157 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 521/1035] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:55 2022] GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490 => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:56.561259 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-35298d31-321a-4df9-837c-3cbdae7a4200 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:56.561893 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-35298d31-321a-4df9-837c-3cbdae7a4200 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: e221a685-4333-48cb-ab94-67a4c0402490] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:56.569424 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-35298d31-321a-4df9-837c-3cbdae7a4200 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:56.570068 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-35298d31-321a-4df9-837c-3cbdae7a4200 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:56.570674 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-35298d31-321a-4df9-837c-3cbdae7a4200 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:56.571584 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-35298d31-321a-4df9-837c-3cbdae7a4200 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:56.572118 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-35298d31-321a-4df9-837c-3cbdae7a4200 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:56.572593 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-35298d31-321a-4df9-837c-3cbdae7a4200 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:56.751302 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-35298d31-321a-4df9-837c-3cbdae7a4200 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:56.761065 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-35298d31-321a-4df9-837c-3cbdae7a4200 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490" status: 200 len: 1453 microversion: 2.1 time: 0.203527 Sep 01 14:13:56.761996 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 515/1036] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:56 2022] GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490 => generated 1453 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:13:56.791081 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-4cabbc4c-8d96-4a92-b92e-90d8ab0ee2a5 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:56.791837 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-4cabbc4c-8d96-4a92-b92e-90d8ab0ee2a5 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: e221a685-4333-48cb-ab94-67a4c0402490] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:13:56.801007 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4cabbc4c-8d96-4a92-b92e-90d8ab0ee2a5 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:56.801620 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4cabbc4c-8d96-4a92-b92e-90d8ab0ee2a5 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:56.803811 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4cabbc4c-8d96-4a92-b92e-90d8ab0ee2a5 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:56.803811 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4cabbc4c-8d96-4a92-b92e-90d8ab0ee2a5 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:13:56.803811 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4cabbc4c-8d96-4a92-b92e-90d8ab0ee2a5 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:13:56.804320 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4cabbc4c-8d96-4a92-b92e-90d8ab0ee2a5 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:13:56.967044 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-4cabbc4c-8d96-4a92-b92e-90d8ab0ee2a5 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:13:56.970085 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell1:SELECT=100 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:13:56.976722 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-4cabbc4c-8d96-4a92-b92e-90d8ab0ee2a5 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490" status: 200 len: 1453 microversion: 2.1 time: 0.190691 Sep 01 14:13:56.977690 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 522/1037] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:13:56 2022] GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490 => generated 1453 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:14:00.121039 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [req-50afc6ca-24f9-4997-81fc-f2607a30b620 req-7a480414-9dd6-45a9-94db-c0a602b81127 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e221a685-4333-48cb-ab94-67a4c0402490", "tag": "96452891-5521-419c-9c6f-b16dbf8fef1e"}]} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:14:00.139602 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_api:SELECT=64 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:14:00.143490 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-50afc6ca-24f9-4997-81fc-f2607a30b620 req-7a480414-9dd6-45a9-94db-c0a602b81127 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:00.144351 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-50afc6ca-24f9-4997-81fc-f2607a30b620 req-7a480414-9dd6-45a9-94db-c0a602b81127 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:00.145366 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-50afc6ca-24f9-4997-81fc-f2607a30b620 req-7a480414-9dd6-45a9-94db-c0a602b81127 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:00.165200 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.compute.server_external_events [req-50afc6ca-24f9-4997-81fc-f2607a30b620 req-7a480414-9dd6-45a9-94db-c0a602b81127 service nova] Creating event network-changed:96452891-5521-419c-9c6f-b16dbf8fef1e for instance e221a685-4333-48cb-ab94-67a4c0402490 on hv-cinder-85221 Sep 01 14:14:00.174803 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [req-50afc6ca-24f9-4997-81fc-f2607a30b620 req-7a480414-9dd6-45a9-94db-c0a602b81127 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059361 Sep 01 14:14:00.177586 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 516/1038] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:14:24.862308 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-74957b06-d754-40e1-940d-509cebf9500f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:24.863748 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-74957b06-d754-40e1-940d-509cebf9500f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:24.867758 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_api:SELECT=9 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:14:24.877659 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-74957b06-d754-40e1-940d-509cebf9500f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:24.878387 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-74957b06-d754-40e1-940d-509cebf9500f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:24.878938 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-74957b06-d754-40e1-940d-509cebf9500f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:24.880115 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-74957b06-d754-40e1-940d-509cebf9500f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:24.880682 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-74957b06-d754-40e1-940d-509cebf9500f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:24.881157 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-74957b06-d754-40e1-940d-509cebf9500f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:24.937816 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-74957b06-d754-40e1-940d-509cebf9500f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.085919 Sep 01 14:14:24.939185 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 523/1039] 10.222.0.25 () {60 vars in 1343 bytes} [Thu Sep 1 14:14:24 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:14:25.009477 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell1:SELECT=43 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:14:25.015481 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-9a374f9c-386a-4c81-921e-c8fde1df4233 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:25.016072 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-9a374f9c-386a-4c81-921e-c8fde1df4233 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:25.022624 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9a374f9c-386a-4c81-921e-c8fde1df4233 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:25.023009 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9a374f9c-386a-4c81-921e-c8fde1df4233 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:25.023450 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9a374f9c-386a-4c81-921e-c8fde1df4233 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:25.024325 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9a374f9c-386a-4c81-921e-c8fde1df4233 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:25.024587 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9a374f9c-386a-4c81-921e-c8fde1df4233 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:25.025016 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9a374f9c-386a-4c81-921e-c8fde1df4233 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:25.058085 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-9a374f9c-386a-4c81-921e-c8fde1df4233 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Going to try to terminate instance {{(pid=121339) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:14:25.534350 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-9a374f9c-386a-4c81-921e-c8fde1df4233 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 204 len: 0 microversion: 2.20 time: 0.526094 Sep 01 14:14:25.534955 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 517/1040] 10.222.0.25 () {60 vars in 1280 bytes} [Thu Sep 1 14:14:25 2022] DELETE /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 01 14:14:25.544504 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-6adc52df-901a-4fcc-ab31-a8dedb72504f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:25.545183 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-6adc52df-901a-4fcc-ab31-a8dedb72504f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:25.551755 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6adc52df-901a-4fcc-ab31-a8dedb72504f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:25.552234 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6adc52df-901a-4fcc-ab31-a8dedb72504f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:25.552655 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6adc52df-901a-4fcc-ab31-a8dedb72504f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:25.553364 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6adc52df-901a-4fcc-ab31-a8dedb72504f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:25.553820 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6adc52df-901a-4fcc-ab31-a8dedb72504f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:25.554295 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6adc52df-901a-4fcc-ab31-a8dedb72504f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:25.712645 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-6adc52df-901a-4fcc-ab31-a8dedb72504f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:14:25.722689 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-6adc52df-901a-4fcc-ab31-a8dedb72504f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:14:25.724128 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-6adc52df-901a-4fcc-ab31-a8dedb72504f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:14:25.725347 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-6adc52df-901a-4fcc-ab31-a8dedb72504f tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1722 microversion: 2.20 time: 0.185857 Sep 01 14:14:25.725948 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 524/1041] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:14:25 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:14:26.751610 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-31b60a99-03df-48b5-a710-a6f74cfde2b3 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:26.752330 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-31b60a99-03df-48b5-a710-a6f74cfde2b3 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:26.759328 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-31b60a99-03df-48b5-a710-a6f74cfde2b3 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:26.759826 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-31b60a99-03df-48b5-a710-a6f74cfde2b3 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:26.760255 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-31b60a99-03df-48b5-a710-a6f74cfde2b3 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:26.761030 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-31b60a99-03df-48b5-a710-a6f74cfde2b3 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:26.761481 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-31b60a99-03df-48b5-a710-a6f74cfde2b3 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:26.762498 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-31b60a99-03df-48b5-a710-a6f74cfde2b3 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:26.947760 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-31b60a99-03df-48b5-a710-a6f74cfde2b3 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:14:26.957943 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-31b60a99-03df-48b5-a710-a6f74cfde2b3 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:14:26.959387 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-31b60a99-03df-48b5-a710-a6f74cfde2b3 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:14:26.960568 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-31b60a99-03df-48b5-a710-a6f74cfde2b3 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1722 microversion: 2.20 time: 0.213559 Sep 01 14:14:26.961134 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 518/1042] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:14:26 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:14:27.995611 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-710b8cdf-cd47-4477-8ad7-0702303cf3bf tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:27.999628 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-710b8cdf-cd47-4477-8ad7-0702303cf3bf tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:28.010032 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-710b8cdf-cd47-4477-8ad7-0702303cf3bf tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:28.011329 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-710b8cdf-cd47-4477-8ad7-0702303cf3bf tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:28.013523 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-710b8cdf-cd47-4477-8ad7-0702303cf3bf tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:28.015454 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-710b8cdf-cd47-4477-8ad7-0702303cf3bf tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:28.016469 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-710b8cdf-cd47-4477-8ad7-0702303cf3bf tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:28.017602 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-710b8cdf-cd47-4477-8ad7-0702303cf3bf tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:28.166952 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-710b8cdf-cd47-4477-8ad7-0702303cf3bf tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:14:28.181974 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-710b8cdf-cd47-4477-8ad7-0702303cf3bf tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:14:28.185389 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-710b8cdf-cd47-4477-8ad7-0702303cf3bf tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:14:28.187265 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-710b8cdf-cd47-4477-8ad7-0702303cf3bf tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1654 microversion: 2.20 time: 0.196759 Sep 01 14:14:28.206907 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 525/1043] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:14:27 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1654 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:14:28.510319 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [req-826dcb7f-da8e-4c52-b945-b0d7ddcb1212 req-3e4aa695-7f7c-43bd-a771-dd00acead06d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1", "name": "network-vif-deleted", "tag": "214b6ab8-206c-4129-a639-f69abbdaa49b"}]} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:14:28.534932 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-826dcb7f-da8e-4c52-b945-b0d7ddcb1212 req-3e4aa695-7f7c-43bd-a771-dd00acead06d service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:28.540327 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-826dcb7f-da8e-4c52-b945-b0d7ddcb1212 req-3e4aa695-7f7c-43bd-a771-dd00acead06d service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:28.544693 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-826dcb7f-da8e-4c52-b945-b0d7ddcb1212 req-3e4aa695-7f7c-43bd-a771-dd00acead06d service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:28.574892 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.compute.server_external_events [req-826dcb7f-da8e-4c52-b945-b0d7ddcb1212 req-3e4aa695-7f7c-43bd-a771-dd00acead06d service nova] Creating event network-vif-deleted:214b6ab8-206c-4129-a639-f69abbdaa49b for instance d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 on hv-cinder-85221 Sep 01 14:14:28.587587 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [req-826dcb7f-da8e-4c52-b945-b0d7ddcb1212 req-3e4aa695-7f7c-43bd-a771-dd00acead06d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081536 Sep 01 14:14:28.589583 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 519/1044] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:14:29.237855 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-529ff607-fc15-4c3e-9d17-94ee03dd5bf9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:29.240050 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-529ff607-fc15-4c3e-9d17-94ee03dd5bf9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:29.250494 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-529ff607-fc15-4c3e-9d17-94ee03dd5bf9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:29.250972 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-529ff607-fc15-4c3e-9d17-94ee03dd5bf9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:29.251624 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-529ff607-fc15-4c3e-9d17-94ee03dd5bf9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:29.252663 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-529ff607-fc15-4c3e-9d17-94ee03dd5bf9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:29.253121 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-529ff607-fc15-4c3e-9d17-94ee03dd5bf9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:29.253806 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-529ff607-fc15-4c3e-9d17-94ee03dd5bf9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:29.293516 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-529ff607-fc15-4c3e-9d17-94ee03dd5bf9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:29.294052 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-529ff607-fc15-4c3e-9d17-94ee03dd5bf9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:29.294497 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-529ff607-fc15-4c3e-9d17-94ee03dd5bf9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:29.294964 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.objects.instance [None req-529ff607-fc15-4c3e-9d17-94ee03dd5bf9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lazy-loading 'fault' on Instance uuid d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 {{(pid=121340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:14:29.346044 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-529ff607-fc15-4c3e-9d17-94ee03dd5bf9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:14:29.367508 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-529ff607-fc15-4c3e-9d17-94ee03dd5bf9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:14:29.367508 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-529ff607-fc15-4c3e-9d17-94ee03dd5bf9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '61401557e7624580b20de6e31c92f785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ed58deb61194a5ba3f2d46eb7e5680c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:14:29.378911 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-529ff607-fc15-4c3e-9d17-94ee03dd5bf9 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 200 len: 1370 microversion: 2.20 time: 0.139282 Sep 01 14:14:29.380082 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 526/1045] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:14:29 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:14:30.418734 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-94ab1348-c09d-47b8-a132-7f8d2e01baac tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:30.420055 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-94ab1348-c09d-47b8-a132-7f8d2e01baac tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:30.429231 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-94ab1348-c09d-47b8-a132-7f8d2e01baac tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:30.429844 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-94ab1348-c09d-47b8-a132-7f8d2e01baac tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:30.430492 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-94ab1348-c09d-47b8-a132-7f8d2e01baac tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:30.431425 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-94ab1348-c09d-47b8-a132-7f8d2e01baac tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:30.432018 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-94ab1348-c09d-47b8-a132-7f8d2e01baac tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:30.432577 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-94ab1348-c09d-47b8-a132-7f8d2e01baac tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:30.448812 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.wsgi [None req-94ab1348-c09d-47b8-a132-7f8d2e01baac tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] HTTP exception thrown: Instance d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 could not be found. Sep 01 14:14:30.450659 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-94ab1348-c09d-47b8-a132-7f8d2e01baac tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Request method failure captured: Sep 01 14:14:30.450659 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: request: GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 HTTP/1.1 Sep 01 14:14:30.450659 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept: application/json Sep 01 14:14:30.450659 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept-Encoding: identity Sep 01 14:14:30.450659 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Connection: close Sep 01 14:14:30.450659 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Length: 0 Sep 01 14:14:30.450659 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Type: application/json Sep 01 14:14:30.450659 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Host: 10.222.0.25 Sep 01 14:14:30.450659 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Openstack-System-Scope: None Sep 01 14:14:30.450659 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: User-Agent: python-urllib3/1.26.12 Sep 01 14:14:30.450659 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Auth-Token: gAAAAABjELxGu0o-Ahu0noh1p5LNsT5msZ4tN-YnSO48-fTSZmnLc3zyBdN_rOjOZVPe8mykmgxYKWEe_6hqOeRaaerWui5gZry7CjSC6FLfKNAlLYSbEfQUNKxvpckkW39tNrunRs6LiExWpLgF4-gJ99jz47GWL1H_XOmr_kT0sEHFyhyAooA Sep 01 14:14:30.450659 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Id: None Sep 01 14:14:30.450659 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Name: None Sep 01 14:14:30.450659 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Identity-Status: Confirmed Sep 01 14:14:30.450659 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Is-Admin-Project: True Sep 01 14:14:30.450659 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 14:14:30.450659 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Id: default Sep 01 14:14:30.450659 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Name: Default Sep 01 14:14:30.450659 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Id: 3ed58deb61194a5ba3f2d46eb7e5680c Sep 01 14:14:30.450659 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1249820830 Sep 01 14:14:30.450659 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Role: member,reader Sep 01 14:14:30.450659 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Roles: member,reader Sep 01 14:14:30.453620 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ed58deb61194a5ba3f2d46eb7e5680c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3ed58deb61194a5ba3f2d46eb7e5680c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ed58deb61194a5ba3f2d46eb7e5680c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3ed58deb61194a5ba3f2d46eb7e5680c"}]}] Sep 01 14:14:30.453620 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1249820830 Sep 01 14:14:30.453620 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Id: 3ed58deb61194a5ba3f2d46eb7e5680c Sep 01 14:14:30.453620 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1249820830 Sep 01 14:14:30.453620 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User: tempest-AttachVolumeShelveTestJSON-1249820830-project Sep 01 14:14:30.453620 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Id: default Sep 01 14:14:30.453620 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Name: Default Sep 01 14:14:30.453620 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Id: 61401557e7624580b20de6e31c92f785 Sep 01 14:14:30.453620 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1249820830-project Sep 01 14:14:30.453620 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: method: > Sep 01 14:14:30.453620 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: exception: Instance d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 could not be found. Sep 01 14:14:30.453620 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: action_args: {'id': 'd1298e8f-49c7-4a76-bc92-4b1fd8dfeac1'} Sep 01 14:14:30.456333 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:14:30.456333 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:14:30.456333 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:14:30.456333 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:14:30.456333 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:14:30.456333 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:14:30.456333 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:14:30.456333 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:14:30.456333 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:14:30.456333 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:14:30.456333 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 could not be found. Sep 01 14:14:30.456333 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:14:30.456333 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:14:30.456333 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:14:30.456333 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:14:30.456333 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:14:30.456333 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:14:30.456333 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:14:30.456333 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:14:30.456333 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:14:30.461100 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:14:30.461100 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:14:30.461100 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:14:30.461100 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:14:30.461100 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:14:30.461100 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:14:30.461100 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:14:30.461100 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 could not be found. Sep 01 14:14:30.461100 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:14:30.461100 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:14:30.461100 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:14:30.461100 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:14:30.461100 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:14:30.461100 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:14:30.461100 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:14:30.461100 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:14:30.461100 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 could not be found. Sep 01 14:14:30.461100 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:14:30.465472 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-94ab1348-c09d-47b8-a132-7f8d2e01baac tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Returning 404 to user: Instance d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 could not be found. {{(pid=121339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:14:30.465472 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-94ab1348-c09d-47b8-a132-7f8d2e01baac tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 404 len: 111 microversion: 2.20 time: 0.039653 Sep 01 14:14:30.465472 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 520/1046] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:14:30 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 01 14:14:30.470522 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-e95a9758-48ea-42ad-8828-da105558a852 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '.version_select at 0x7f98678d5940>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:30.576355 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-e95a9758-48ea-42ad-8828-da105558a852 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-211649193" status: 204 len: 0 microversion: 2.20 time: 0.117313 Sep 01 14:14:30.578783 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 527/1047] 10.222.0.25 () {60 vars in 1259 bytes} [Thu Sep 1 14:14:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-211649193 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 14:14:32.827988 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-ab8aad11-1543-4517-ad24-f06d2074d5ba tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:32.828698 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-ab8aad11-1543-4517-ad24-f06d2074d5ba tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:32.830380 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [req-94ea8067-4c5e-4e75-8d23-d97b5ae49682 req-8a93ce84-950e-4e79-8647-3cfec47eb8a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cc866f4-91c1-4384-b88a-5866ca150aea", "tag": "9b44c940-faa5-4df3-83f2-2d676ad70287"}]} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:14:32.844801 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-94ea8067-4c5e-4e75-8d23-d97b5ae49682 req-8a93ce84-950e-4e79-8647-3cfec47eb8a8 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:32.845712 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-94ea8067-4c5e-4e75-8d23-d97b5ae49682 req-8a93ce84-950e-4e79-8647-3cfec47eb8a8 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:32.848698 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-94ea8067-4c5e-4e75-8d23-d97b5ae49682 req-8a93ce84-950e-4e79-8647-3cfec47eb8a8 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:32.850495 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ab8aad11-1543-4517-ad24-f06d2074d5ba tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:32.851439 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ab8aad11-1543-4517-ad24-f06d2074d5ba tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:32.852943 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ab8aad11-1543-4517-ad24-f06d2074d5ba tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:32.853470 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ab8aad11-1543-4517-ad24-f06d2074d5ba tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:32.865496 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ab8aad11-1543-4517-ad24-f06d2074d5ba tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:32.868626 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-ab8aad11-1543-4517-ad24-f06d2074d5ba tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:32.873418 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.compute.server_external_events [req-94ea8067-4c5e-4e75-8d23-d97b5ae49682 req-8a93ce84-950e-4e79-8647-3cfec47eb8a8 service nova] Creating event network-changed:9b44c940-faa5-4df3-83f2-2d676ad70287 for instance 3cc866f4-91c1-4384-b88a-5866ca150aea on hv-cinder-85221 Sep 01 14:14:32.884197 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [req-94ea8067-4c5e-4e75-8d23-d97b5ae49682 req-8a93ce84-950e-4e79-8647-3cfec47eb8a8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060633 Sep 01 14:14:32.886102 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 528/1048] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:14:32.912088 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-ab8aad11-1543-4517-ad24-f06d2074d5ba tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Going to try to terminate instance {{(pid=121339) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:14:33.346713 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-ab8aad11-1543-4517-ad24-f06d2074d5ba tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 204 len: 0 microversion: 2.1 time: 0.526067 Sep 01 14:14:33.351765 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 521/1049] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 14:14:32 2022] DELETE /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 0 bytes in 529 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:14:33.362873 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-1aeea86b-ae8a-477b-9536-a850854b9c9c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:33.364104 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-1aeea86b-ae8a-477b-9536-a850854b9c9c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:33.379015 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1aeea86b-ae8a-477b-9536-a850854b9c9c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:33.379919 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1aeea86b-ae8a-477b-9536-a850854b9c9c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:33.382526 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1aeea86b-ae8a-477b-9536-a850854b9c9c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:33.383281 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1aeea86b-ae8a-477b-9536-a850854b9c9c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:33.384426 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1aeea86b-ae8a-477b-9536-a850854b9c9c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:33.385418 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1aeea86b-ae8a-477b-9536-a850854b9c9c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:33.601934 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-1aeea86b-ae8a-477b-9536-a850854b9c9c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:14:33.615395 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-1aeea86b-ae8a-477b-9536-a850854b9c9c tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1568 microversion: 2.1 time: 0.261691 Sep 01 14:14:33.615992 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 529/1050] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:14:33 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1568 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:14:34.640713 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-7650b35e-5ca8-441c-a6db-465a6dfa19cb tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:34.641564 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-7650b35e-5ca8-441c-a6db-465a6dfa19cb tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:34.649858 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7650b35e-5ca8-441c-a6db-465a6dfa19cb tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:34.650389 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7650b35e-5ca8-441c-a6db-465a6dfa19cb tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:34.650833 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7650b35e-5ca8-441c-a6db-465a6dfa19cb tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:34.652638 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7650b35e-5ca8-441c-a6db-465a6dfa19cb tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:34.653528 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7650b35e-5ca8-441c-a6db-465a6dfa19cb tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:34.653668 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-7650b35e-5ca8-441c-a6db-465a6dfa19cb tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:34.832453 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-7650b35e-5ca8-441c-a6db-465a6dfa19cb tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:14:34.847466 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-7650b35e-5ca8-441c-a6db-465a6dfa19cb tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1568 microversion: 2.1 time: 0.212631 Sep 01 14:14:34.848523 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 522/1051] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:14:34 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1568 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:14:35.586776 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-62cfcf0d-032e-4e14-930a-fd6dbea7df27 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:35.587661 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-62cfcf0d-032e-4e14-930a-fd6dbea7df27 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:35.599555 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-62cfcf0d-032e-4e14-930a-fd6dbea7df27 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:35.600375 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-62cfcf0d-032e-4e14-930a-fd6dbea7df27 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:35.601102 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-62cfcf0d-032e-4e14-930a-fd6dbea7df27 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:35.602449 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-62cfcf0d-032e-4e14-930a-fd6dbea7df27 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:35.603211 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-62cfcf0d-032e-4e14-930a-fd6dbea7df27 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:35.603956 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-62cfcf0d-032e-4e14-930a-fd6dbea7df27 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:35.635494 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.wsgi [None req-62cfcf0d-032e-4e14-930a-fd6dbea7df27 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] HTTP exception thrown: Instance d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 could not be found. Sep 01 14:14:35.639320 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-62cfcf0d-032e-4e14-930a-fd6dbea7df27 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Request method failure captured: Sep 01 14:14:35.639320 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: request: DELETE /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 HTTP/1.1 Sep 01 14:14:35.639320 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept: application/json Sep 01 14:14:35.639320 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept-Encoding: identity Sep 01 14:14:35.639320 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Connection: close Sep 01 14:14:35.639320 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Length: 0 Sep 01 14:14:35.639320 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Type: application/json Sep 01 14:14:35.639320 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Host: 10.222.0.25 Sep 01 14:14:35.639320 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Openstack-System-Scope: None Sep 01 14:14:35.639320 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: User-Agent: python-urllib3/1.26.12 Sep 01 14:14:35.639320 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Auth-Token: gAAAAABjELxGu0o-Ahu0noh1p5LNsT5msZ4tN-YnSO48-fTSZmnLc3zyBdN_rOjOZVPe8mykmgxYKWEe_6hqOeRaaerWui5gZry7CjSC6FLfKNAlLYSbEfQUNKxvpckkW39tNrunRs6LiExWpLgF4-gJ99jz47GWL1H_XOmr_kT0sEHFyhyAooA Sep 01 14:14:35.639320 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Id: None Sep 01 14:14:35.639320 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Name: None Sep 01 14:14:35.639320 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Identity-Status: Confirmed Sep 01 14:14:35.639320 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Is-Admin-Project: True Sep 01 14:14:35.639320 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 14:14:35.639320 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Id: default Sep 01 14:14:35.639320 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Name: Default Sep 01 14:14:35.639320 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Id: 3ed58deb61194a5ba3f2d46eb7e5680c Sep 01 14:14:35.639320 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1249820830 Sep 01 14:14:35.639320 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Role: member,reader Sep 01 14:14:35.639320 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Roles: member,reader Sep 01 14:14:35.641062 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ed58deb61194a5ba3f2d46eb7e5680c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3ed58deb61194a5ba3f2d46eb7e5680c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ed58deb61194a5ba3f2d46eb7e5680c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3ed58deb61194a5ba3f2d46eb7e5680c"}]}] Sep 01 14:14:35.641062 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1249820830 Sep 01 14:14:35.641062 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Id: 3ed58deb61194a5ba3f2d46eb7e5680c Sep 01 14:14:35.641062 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1249820830 Sep 01 14:14:35.641062 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User: tempest-AttachVolumeShelveTestJSON-1249820830-project Sep 01 14:14:35.641062 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Id: default Sep 01 14:14:35.641062 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Name: Default Sep 01 14:14:35.641062 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Id: 61401557e7624580b20de6e31c92f785 Sep 01 14:14:35.641062 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1249820830-project Sep 01 14:14:35.641062 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: method: > Sep 01 14:14:35.641062 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: exception: Instance d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 could not be found. Sep 01 14:14:35.641062 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: action_args: {'id': 'd1298e8f-49c7-4a76-bc92-4b1fd8dfeac1'} Sep 01 14:14:35.641943 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:14:35.641943 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:14:35.641943 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:14:35.641943 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:14:35.641943 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:14:35.641943 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:14:35.641943 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:14:35.641943 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:14:35.641943 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:14:35.641943 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:14:35.641943 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 could not be found. Sep 01 14:14:35.641943 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:14:35.641943 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:14:35.641943 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:14:35.641943 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:14:35.641943 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:14:35.641943 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:14:35.641943 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:14:35.641943 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:14:35.641943 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:14:35.643295 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:14:35.643295 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 14:14:35.643295 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 14:14:35.643295 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 14:14:35.643295 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 14:14:35.643295 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:14:35.643295 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:14:35.643295 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:14:35.643295 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:14:35.643295 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 could not be found. Sep 01 14:14:35.643295 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:14:35.643295 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:14:35.643295 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:14:35.643295 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:14:35.643295 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:14:35.643295 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:14:35.643295 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:14:35.643295 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:14:35.643295 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 could not be found. Sep 01 14:14:35.643295 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:14:35.646627 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-62cfcf0d-032e-4e14-930a-fd6dbea7df27 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Returning 404 to user: Instance d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 could not be found. {{(pid=121340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:14:35.646627 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-62cfcf0d-032e-4e14-930a-fd6dbea7df27 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 404 len: 111 microversion: 2.20 time: 0.069193 Sep 01 14:14:35.646627 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 530/1052] 10.222.0.25 () {60 vars in 1280 bytes} [Thu Sep 1 14:14:35 2022] DELETE /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 14:14:35.651574 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-666efaa7-7c73-4484-ae55-4f3edb7eb095 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:35.652602 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-666efaa7-7c73-4484-ae55-4f3edb7eb095 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:35.665540 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-666efaa7-7c73-4484-ae55-4f3edb7eb095 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:35.666585 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-666efaa7-7c73-4484-ae55-4f3edb7eb095 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:35.667940 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-666efaa7-7c73-4484-ae55-4f3edb7eb095 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:35.670029 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-666efaa7-7c73-4484-ae55-4f3edb7eb095 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:35.671405 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-666efaa7-7c73-4484-ae55-4f3edb7eb095 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:35.672275 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-666efaa7-7c73-4484-ae55-4f3edb7eb095 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:35.709313 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.wsgi [None req-666efaa7-7c73-4484-ae55-4f3edb7eb095 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] HTTP exception thrown: Instance d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 could not be found. Sep 01 14:14:35.712979 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-666efaa7-7c73-4484-ae55-4f3edb7eb095 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Request method failure captured: Sep 01 14:14:35.712979 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: request: GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 HTTP/1.1 Sep 01 14:14:35.712979 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept: application/json Sep 01 14:14:35.712979 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept-Encoding: identity Sep 01 14:14:35.712979 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Connection: close Sep 01 14:14:35.712979 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Length: 0 Sep 01 14:14:35.712979 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Type: application/json Sep 01 14:14:35.712979 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Host: 10.222.0.25 Sep 01 14:14:35.712979 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Openstack-System-Scope: None Sep 01 14:14:35.712979 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: User-Agent: python-urllib3/1.26.12 Sep 01 14:14:35.712979 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Auth-Token: gAAAAABjELxGu0o-Ahu0noh1p5LNsT5msZ4tN-YnSO48-fTSZmnLc3zyBdN_rOjOZVPe8mykmgxYKWEe_6hqOeRaaerWui5gZry7CjSC6FLfKNAlLYSbEfQUNKxvpckkW39tNrunRs6LiExWpLgF4-gJ99jz47GWL1H_XOmr_kT0sEHFyhyAooA Sep 01 14:14:35.712979 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Id: None Sep 01 14:14:35.712979 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Name: None Sep 01 14:14:35.712979 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Identity-Status: Confirmed Sep 01 14:14:35.712979 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Is-Admin-Project: True Sep 01 14:14:35.712979 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 14:14:35.712979 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Id: default Sep 01 14:14:35.712979 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Name: Default Sep 01 14:14:35.712979 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Id: 3ed58deb61194a5ba3f2d46eb7e5680c Sep 01 14:14:35.712979 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1249820830 Sep 01 14:14:35.712979 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Role: member,reader Sep 01 14:14:35.712979 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Roles: member,reader Sep 01 14:14:35.715950 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ed58deb61194a5ba3f2d46eb7e5680c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3ed58deb61194a5ba3f2d46eb7e5680c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ed58deb61194a5ba3f2d46eb7e5680c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3ed58deb61194a5ba3f2d46eb7e5680c"}]}] Sep 01 14:14:35.715950 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1249820830 Sep 01 14:14:35.715950 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Id: 3ed58deb61194a5ba3f2d46eb7e5680c Sep 01 14:14:35.715950 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1249820830 Sep 01 14:14:35.715950 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User: tempest-AttachVolumeShelveTestJSON-1249820830-project Sep 01 14:14:35.715950 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Id: default Sep 01 14:14:35.715950 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Name: Default Sep 01 14:14:35.715950 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Id: 61401557e7624580b20de6e31c92f785 Sep 01 14:14:35.715950 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1249820830-project Sep 01 14:14:35.715950 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: method: > Sep 01 14:14:35.715950 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: exception: Instance d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 could not be found. Sep 01 14:14:35.715950 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: action_args: {'id': 'd1298e8f-49c7-4a76-bc92-4b1fd8dfeac1'} Sep 01 14:14:35.717500 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:14:35.717500 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:14:35.717500 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:14:35.717500 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:14:35.717500 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:14:35.717500 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:14:35.717500 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:14:35.717500 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:14:35.717500 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:14:35.717500 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:14:35.717500 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 could not be found. Sep 01 14:14:35.717500 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:14:35.717500 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:14:35.717500 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:14:35.717500 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:14:35.717500 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:14:35.717500 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:14:35.717500 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:14:35.717500 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:14:35.717500 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:14:35.721438 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:14:35.721438 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:14:35.721438 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:14:35.721438 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:14:35.721438 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:14:35.721438 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:14:35.721438 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:14:35.721438 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 could not be found. Sep 01 14:14:35.721438 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:14:35.721438 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:14:35.721438 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:14:35.721438 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:14:35.721438 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:14:35.721438 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:14:35.721438 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:14:35.721438 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:14:35.721438 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 could not be found. Sep 01 14:14:35.721438 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:14:35.723973 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-666efaa7-7c73-4484-ae55-4f3edb7eb095 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Returning 404 to user: Instance d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 could not be found. {{(pid=121339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:14:35.723973 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-666efaa7-7c73-4484-ae55-4f3edb7eb095 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1" status: 404 len: 111 microversion: 2.20 time: 0.068275 Sep 01 14:14:35.723973 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 523/1053] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:14:35 2022] GET /compute/v2.1/servers/d1298e8f-49c7-4a76-bc92-4b1fd8dfeac1 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 14:14:35.872492 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-45f30ffe-a20b-4483-8541-40170aeba4e5 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:35.873232 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-45f30ffe-a20b-4483-8541-40170aeba4e5 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:35.883281 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-45f30ffe-a20b-4483-8541-40170aeba4e5 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:35.884288 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-45f30ffe-a20b-4483-8541-40170aeba4e5 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:35.885294 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-45f30ffe-a20b-4483-8541-40170aeba4e5 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:35.888022 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-45f30ffe-a20b-4483-8541-40170aeba4e5 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:35.889006 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-45f30ffe-a20b-4483-8541-40170aeba4e5 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:35.894543 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-45f30ffe-a20b-4483-8541-40170aeba4e5 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:36.291605 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-45f30ffe-a20b-4483-8541-40170aeba4e5 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:14:36.306908 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-45f30ffe-a20b-4483-8541-40170aeba4e5 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1568 microversion: 2.1 time: 0.439291 Sep 01 14:14:36.307827 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 531/1054] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:14:35 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1568 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:14:37.238489 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-8c01f23a-ecee-44b6-8320-2ac839b6386c tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:37.240331 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-8c01f23a-ecee-44b6-8320-2ac839b6386c tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: f21e2730-924a-436f-a04b-ce7bc9b47ea9] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:37.247560 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8c01f23a-ecee-44b6-8320-2ac839b6386c tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:37.248050 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8c01f23a-ecee-44b6-8320-2ac839b6386c tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:37.248945 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8c01f23a-ecee-44b6-8320-2ac839b6386c tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:37.249879 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8c01f23a-ecee-44b6-8320-2ac839b6386c tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:37.250385 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8c01f23a-ecee-44b6-8320-2ac839b6386c tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:37.250811 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8c01f23a-ecee-44b6-8320-2ac839b6386c tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:37.252803 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-73e14765-f0e4-47b4-a791-a4f3287aaaf5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:37.253686 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-73e14765-f0e4-47b4-a791-a4f3287aaaf5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:37.264798 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-73e14765-f0e4-47b4-a791-a4f3287aaaf5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:37.266485 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-73e14765-f0e4-47b4-a791-a4f3287aaaf5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:37.267295 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-73e14765-f0e4-47b4-a791-a4f3287aaaf5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:37.268583 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-73e14765-f0e4-47b4-a791-a4f3287aaaf5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:37.269467 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-73e14765-f0e4-47b4-a791-a4f3287aaaf5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:37.270321 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-73e14765-f0e4-47b4-a791-a4f3287aaaf5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:37.287728 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-8c01f23a-ecee-44b6-8320-2ac839b6386c tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9/ips" status: 200 len: 150 microversion: 2.1 time: 0.053678 Sep 01 14:14:37.288586 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 524/1055] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Sep 1 14:14:37 2022] GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9/ips => generated 150 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:14:37.297336 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.wsgi [None req-73e14765-f0e4-47b4-a791-a4f3287aaaf5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] HTTP exception thrown: Instance d39f7090-b419-46be-9fcc-7ae73004ab71 could not be found. Sep 01 14:14:37.299945 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-73e14765-f0e4-47b4-a791-a4f3287aaaf5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Request method failure captured: Sep 01 14:14:37.299945 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: request: DELETE /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 HTTP/1.1 Sep 01 14:14:37.299945 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept: application/json Sep 01 14:14:37.299945 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept-Encoding: identity Sep 01 14:14:37.299945 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Connection: close Sep 01 14:14:37.299945 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Length: 0 Sep 01 14:14:37.299945 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Type: application/json Sep 01 14:14:37.299945 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Host: 10.222.0.25 Sep 01 14:14:37.299945 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Openstack-System-Scope: None Sep 01 14:14:37.299945 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: User-Agent: python-urllib3/1.26.12 Sep 01 14:14:37.299945 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Auth-Token: gAAAAABjELxGu0o-Ahu0noh1p5LNsT5msZ4tN-YnSO48-fTSZmnLc3zyBdN_rOjOZVPe8mykmgxYKWEe_6hqOeRaaerWui5gZry7CjSC6FLfKNAlLYSbEfQUNKxvpckkW39tNrunRs6LiExWpLgF4-gJ99jz47GWL1H_XOmr_kT0sEHFyhyAooA Sep 01 14:14:37.299945 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Id: None Sep 01 14:14:37.299945 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Name: None Sep 01 14:14:37.299945 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Identity-Status: Confirmed Sep 01 14:14:37.299945 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Is-Admin-Project: True Sep 01 14:14:37.299945 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 14:14:37.299945 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Id: default Sep 01 14:14:37.299945 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Name: Default Sep 01 14:14:37.299945 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Id: 3ed58deb61194a5ba3f2d46eb7e5680c Sep 01 14:14:37.299945 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1249820830 Sep 01 14:14:37.299945 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Role: member,reader Sep 01 14:14:37.299945 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Roles: member,reader Sep 01 14:14:37.306713 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ed58deb61194a5ba3f2d46eb7e5680c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3ed58deb61194a5ba3f2d46eb7e5680c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ed58deb61194a5ba3f2d46eb7e5680c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3ed58deb61194a5ba3f2d46eb7e5680c"}]}] Sep 01 14:14:37.306713 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1249820830 Sep 01 14:14:37.306713 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Id: 3ed58deb61194a5ba3f2d46eb7e5680c Sep 01 14:14:37.306713 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1249820830 Sep 01 14:14:37.306713 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User: tempest-AttachVolumeShelveTestJSON-1249820830-project Sep 01 14:14:37.306713 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Id: default Sep 01 14:14:37.306713 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Name: Default Sep 01 14:14:37.306713 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Id: 61401557e7624580b20de6e31c92f785 Sep 01 14:14:37.306713 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1249820830-project Sep 01 14:14:37.306713 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: method: > Sep 01 14:14:37.306713 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: exception: Instance d39f7090-b419-46be-9fcc-7ae73004ab71 could not be found. Sep 01 14:14:37.306713 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: action_args: {'id': 'd39f7090-b419-46be-9fcc-7ae73004ab71'} Sep 01 14:14:37.307717 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:14:37.307717 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:14:37.307717 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:14:37.307717 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:14:37.307717 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:14:37.307717 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:14:37.307717 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:14:37.307717 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:14:37.307717 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:14:37.307717 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:14:37.307717 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d39f7090-b419-46be-9fcc-7ae73004ab71 could not be found. Sep 01 14:14:37.307717 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:14:37.307717 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:14:37.307717 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:14:37.307717 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:14:37.307717 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:14:37.307717 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:14:37.307717 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:14:37.307717 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:14:37.307717 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:14:37.309394 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:14:37.309394 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 14:14:37.309394 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 14:14:37.309394 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 14:14:37.309394 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 14:14:37.309394 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:14:37.309394 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:14:37.309394 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:14:37.309394 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:14:37.309394 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d39f7090-b419-46be-9fcc-7ae73004ab71 could not be found. Sep 01 14:14:37.309394 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:14:37.309394 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:14:37.309394 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:14:37.309394 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:14:37.309394 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:14:37.309394 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:14:37.309394 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:14:37.309394 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:14:37.309394 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d39f7090-b419-46be-9fcc-7ae73004ab71 could not be found. Sep 01 14:14:37.309394 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:14:37.311055 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-73e14765-f0e4-47b4-a791-a4f3287aaaf5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Returning 404 to user: Instance d39f7090-b419-46be-9fcc-7ae73004ab71 could not be found. {{(pid=121340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:14:37.311055 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-73e14765-f0e4-47b4-a791-a4f3287aaaf5 tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 404 len: 111 microversion: 2.20 time: 0.053852 Sep 01 14:14:37.311055 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 532/1056] 10.222.0.25 () {60 vars in 1280 bytes} [Thu Sep 1 14:14:37 2022] DELETE /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 14:14:37.311313 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [req-dba3f9b2-3b08-4945-b066-28512491a1dd req-f7fe3409-8475-43a0-a2d8-490da4a96c16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cc866f4-91c1-4384-b88a-5866ca150aea", "name": "network-vif-deleted", "tag": "9b44c940-faa5-4df3-83f2-2d676ad70287"}]} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:14:37.316803 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-6b5c7883-2f24-4b6a-a762-9288bddf993b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:37.317438 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-6b5c7883-2f24-4b6a-a762-9288bddf993b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] [instance: d39f7090-b419-46be-9fcc-7ae73004ab71] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:37.325161 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-dba3f9b2-3b08-4945-b066-28512491a1dd req-f7fe3409-8475-43a0-a2d8-490da4a96c16 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:37.325707 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-dba3f9b2-3b08-4945-b066-28512491a1dd req-f7fe3409-8475-43a0-a2d8-490da4a96c16 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:37.325920 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6b5c7883-2f24-4b6a-a762-9288bddf993b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:37.328647 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-dba3f9b2-3b08-4945-b066-28512491a1dd req-f7fe3409-8475-43a0-a2d8-490da4a96c16 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:37.328886 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6b5c7883-2f24-4b6a-a762-9288bddf993b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:37.328886 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6b5c7883-2f24-4b6a-a762-9288bddf993b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:37.328886 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6b5c7883-2f24-4b6a-a762-9288bddf993b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:37.328886 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6b5c7883-2f24-4b6a-a762-9288bddf993b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:37.329476 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6b5c7883-2f24-4b6a-a762-9288bddf993b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:37.351618 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.compute.server_external_events [req-dba3f9b2-3b08-4945-b066-28512491a1dd req-f7fe3409-8475-43a0-a2d8-490da4a96c16 service nova] Creating event network-vif-deleted:9b44c940-faa5-4df3-83f2-2d676ad70287 for instance 3cc866f4-91c1-4384-b88a-5866ca150aea on hv-cinder-85221 Sep 01 14:14:37.359912 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [req-dba3f9b2-3b08-4945-b066-28512491a1dd req-f7fe3409-8475-43a0-a2d8-490da4a96c16 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062136 Sep 01 14:14:37.362427 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 525/1057] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:14:37.372501 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.wsgi [None req-6b5c7883-2f24-4b6a-a762-9288bddf993b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] HTTP exception thrown: Instance d39f7090-b419-46be-9fcc-7ae73004ab71 could not be found. Sep 01 14:14:37.373371 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-6e89c0ae-82da-48ed-94f4-ac8c9010f224 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:37.374300 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-6e89c0ae-82da-48ed-94f4-ac8c9010f224 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:37.377206 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-6b5c7883-2f24-4b6a-a762-9288bddf993b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Request method failure captured: Sep 01 14:14:37.377206 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: request: GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 HTTP/1.1 Sep 01 14:14:37.377206 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept: application/json Sep 01 14:14:37.377206 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept-Encoding: identity Sep 01 14:14:37.377206 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Connection: close Sep 01 14:14:37.377206 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Length: 0 Sep 01 14:14:37.377206 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Type: application/json Sep 01 14:14:37.377206 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Host: 10.222.0.25 Sep 01 14:14:37.377206 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Openstack-System-Scope: None Sep 01 14:14:37.377206 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: User-Agent: python-urllib3/1.26.12 Sep 01 14:14:37.377206 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Auth-Token: gAAAAABjELxGu0o-Ahu0noh1p5LNsT5msZ4tN-YnSO48-fTSZmnLc3zyBdN_rOjOZVPe8mykmgxYKWEe_6hqOeRaaerWui5gZry7CjSC6FLfKNAlLYSbEfQUNKxvpckkW39tNrunRs6LiExWpLgF4-gJ99jz47GWL1H_XOmr_kT0sEHFyhyAooA Sep 01 14:14:37.377206 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Id: None Sep 01 14:14:37.377206 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Name: None Sep 01 14:14:37.377206 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Identity-Status: Confirmed Sep 01 14:14:37.377206 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Is-Admin-Project: True Sep 01 14:14:37.377206 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 14:14:37.377206 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Id: default Sep 01 14:14:37.377206 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Name: Default Sep 01 14:14:37.377206 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Id: 3ed58deb61194a5ba3f2d46eb7e5680c Sep 01 14:14:37.377206 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1249820830 Sep 01 14:14:37.377206 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Role: member,reader Sep 01 14:14:37.377206 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Roles: member,reader Sep 01 14:14:37.378974 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ed58deb61194a5ba3f2d46eb7e5680c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3ed58deb61194a5ba3f2d46eb7e5680c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3ed58deb61194a5ba3f2d46eb7e5680c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3ed58deb61194a5ba3f2d46eb7e5680c"}]}] Sep 01 14:14:37.378974 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1249820830 Sep 01 14:14:37.378974 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Id: 3ed58deb61194a5ba3f2d46eb7e5680c Sep 01 14:14:37.378974 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1249820830 Sep 01 14:14:37.378974 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User: tempest-AttachVolumeShelveTestJSON-1249820830-project Sep 01 14:14:37.378974 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Id: default Sep 01 14:14:37.378974 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Name: Default Sep 01 14:14:37.378974 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Id: 61401557e7624580b20de6e31c92f785 Sep 01 14:14:37.378974 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1249820830-project Sep 01 14:14:37.378974 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: method: > Sep 01 14:14:37.378974 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: exception: Instance d39f7090-b419-46be-9fcc-7ae73004ab71 could not be found. Sep 01 14:14:37.378974 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: action_args: {'id': 'd39f7090-b419-46be-9fcc-7ae73004ab71'} Sep 01 14:14:37.380147 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:14:37.380147 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:14:37.380147 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:14:37.380147 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:14:37.380147 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:14:37.380147 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:14:37.380147 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:14:37.380147 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:14:37.380147 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:14:37.380147 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:14:37.380147 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d39f7090-b419-46be-9fcc-7ae73004ab71 could not be found. Sep 01 14:14:37.380147 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:14:37.380147 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:14:37.380147 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:14:37.380147 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:14:37.380147 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:14:37.380147 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:14:37.380147 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:14:37.380147 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:14:37.380147 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:14:37.381770 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:14:37.381770 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:14:37.381770 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:14:37.381770 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:14:37.381770 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:14:37.381770 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:14:37.381770 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:14:37.381770 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d39f7090-b419-46be-9fcc-7ae73004ab71 could not be found. Sep 01 14:14:37.381770 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:14:37.381770 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:14:37.381770 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:14:37.381770 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:14:37.381770 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:14:37.381770 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:14:37.381770 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:14:37.381770 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:14:37.381770 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d39f7090-b419-46be-9fcc-7ae73004ab71 could not be found. Sep 01 14:14:37.381770 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:14:37.388590 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6e89c0ae-82da-48ed-94f4-ac8c9010f224 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:37.390017 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6e89c0ae-82da-48ed-94f4-ac8c9010f224 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:37.390995 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6e89c0ae-82da-48ed-94f4-ac8c9010f224 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:37.393040 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-6b5c7883-2f24-4b6a-a762-9288bddf993b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] Returning 404 to user: Instance d39f7090-b419-46be-9fcc-7ae73004ab71 could not be found. {{(pid=121340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:14:37.393542 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6e89c0ae-82da-48ed-94f4-ac8c9010f224 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:37.394632 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6e89c0ae-82da-48ed-94f4-ac8c9010f224 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:37.394846 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-6b5c7883-2f24-4b6a-a762-9288bddf993b tempest-AttachVolumeShelveTestJSON-1249820830 tempest-AttachVolumeShelveTestJSON-1249820830-project] 10.222.0.25 "GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71" status: 404 len: 111 microversion: 2.20 time: 0.081741 Sep 01 14:14:37.395456 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6e89c0ae-82da-48ed-94f4-ac8c9010f224 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:37.396371 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 533/1058] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 14:14:37 2022] GET /compute/v2.1/servers/d39f7090-b419-46be-9fcc-7ae73004ab71 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 14:14:37.479305 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-6e89c0ae-82da-48ed-94f4-ac8c9010f224 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:14:37.489103 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-6e89c0ae-82da-48ed-94f4-ac8c9010f224 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1383 microversion: 2.1 time: 0.124648 Sep 01 14:14:37.495668 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 526/1059] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:14:37 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1383 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:14:38.532120 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-f890af69-a77f-40cc-8f98-7e2defa2803b tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:38.532913 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-f890af69-a77f-40cc-8f98-7e2defa2803b tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:38.543194 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f890af69-a77f-40cc-8f98-7e2defa2803b tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:38.543986 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f890af69-a77f-40cc-8f98-7e2defa2803b tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:38.545078 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f890af69-a77f-40cc-8f98-7e2defa2803b tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:38.546382 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f890af69-a77f-40cc-8f98-7e2defa2803b tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:38.547213 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f890af69-a77f-40cc-8f98-7e2defa2803b tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:38.547973 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f890af69-a77f-40cc-8f98-7e2defa2803b tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:38.712846 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-f890af69-a77f-40cc-8f98-7e2defa2803b tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:14:38.730093 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-f890af69-a77f-40cc-8f98-7e2defa2803b tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1383 microversion: 2.1 time: 0.202503 Sep 01 14:14:38.737090 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 534/1060] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:14:38 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1383 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:14:39.766294 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-73787e7d-f94c-426f-bc2d-c1284e42285e tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:39.767545 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-73787e7d-f94c-426f-bc2d-c1284e42285e tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:39.776375 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-73787e7d-f94c-426f-bc2d-c1284e42285e tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:39.785532 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-73787e7d-f94c-426f-bc2d-c1284e42285e tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:39.785532 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-73787e7d-f94c-426f-bc2d-c1284e42285e tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:39.785532 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-73787e7d-f94c-426f-bc2d-c1284e42285e tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:39.785532 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-73787e7d-f94c-426f-bc2d-c1284e42285e tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:39.786155 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-73787e7d-f94c-426f-bc2d-c1284e42285e tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:39.949747 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-73787e7d-f94c-426f-bc2d-c1284e42285e tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:14:39.963311 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-73787e7d-f94c-426f-bc2d-c1284e42285e tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1220 microversion: 2.1 time: 0.205699 Sep 01 14:14:39.965872 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 527/1061] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:14:39 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1220 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:14:40.891847 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-4f806b1f-2078-467f-84b8-88045476ebd9 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0aed1c9a-e42e-4ead-b759-cd05c561b577"}} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:14:40.896633 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-4f806b1f-2078-467f-84b8-88045476ebd9 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: f21e2730-924a-436f-a04b-ce7bc9b47ea9] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:40.909977 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4f806b1f-2078-467f-84b8-88045476ebd9 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:40.912352 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4f806b1f-2078-467f-84b8-88045476ebd9 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:40.913975 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4f806b1f-2078-467f-84b8-88045476ebd9 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:40.915747 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4f806b1f-2078-467f-84b8-88045476ebd9 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:40.917032 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4f806b1f-2078-467f-84b8-88045476ebd9 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:40.918776 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-4f806b1f-2078-467f-84b8-88045476ebd9 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:41.013030 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-2e8a7f32-98b1-4c13-becf-0fbb336b9bc1 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:41.023226 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-2e8a7f32-98b1-4c13-becf-0fbb336b9bc1 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:41.043248 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2e8a7f32-98b1-4c13-becf-0fbb336b9bc1 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:41.044185 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2e8a7f32-98b1-4c13-becf-0fbb336b9bc1 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:41.045107 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2e8a7f32-98b1-4c13-becf-0fbb336b9bc1 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:41.046583 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2e8a7f32-98b1-4c13-becf-0fbb336b9bc1 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:41.047464 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2e8a7f32-98b1-4c13-becf-0fbb336b9bc1 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:41.048314 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2e8a7f32-98b1-4c13-becf-0fbb336b9bc1 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:41.112700 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2e8a7f32-98b1-4c13-becf-0fbb336b9bc1 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:41.113249 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2e8a7f32-98b1-4c13-becf-0fbb336b9bc1 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:41.113964 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-2e8a7f32-98b1-4c13-becf-0fbb336b9bc1 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:41.114525 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.objects.instance [None req-2e8a7f32-98b1-4c13-becf-0fbb336b9bc1 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lazy-loading 'fault' on Instance uuid 3cc866f4-91c1-4384-b88a-5866ca150aea {{(pid=121339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:14:41.197072 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-2e8a7f32-98b1-4c13-becf-0fbb336b9bc1 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af1f81b83784472abc4b6ff4393afb7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c061b824cb4a92a469061e7a67f967', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:14:41.221956 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-2e8a7f32-98b1-4c13-becf-0fbb336b9bc1 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 200 len: 1225 microversion: 2.1 time: 0.220086 Sep 01 14:14:41.223498 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 528/1062] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:14:40 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 1225 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:14:42.140714 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-4f806b1f-2078-467f-84b8-88045476ebd9 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "POST /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.257036 Sep 01 14:14:42.141716 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 535/1063] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Sep 1 14:14:40 2022] POST /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9/os-volume_attachments => generated 194 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:14:42.255300 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-6f4c795c-c4b1-4bd5-934b-7db242a11e09 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:42.256506 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-6f4c795c-c4b1-4bd5-934b-7db242a11e09 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] [instance: 3cc866f4-91c1-4384-b88a-5866ca150aea] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:42.267074 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6f4c795c-c4b1-4bd5-934b-7db242a11e09 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:42.267887 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6f4c795c-c4b1-4bd5-934b-7db242a11e09 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:42.268574 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6f4c795c-c4b1-4bd5-934b-7db242a11e09 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:42.270288 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6f4c795c-c4b1-4bd5-934b-7db242a11e09 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:42.271392 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6f4c795c-c4b1-4bd5-934b-7db242a11e09 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:42.272312 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6f4c795c-c4b1-4bd5-934b-7db242a11e09 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:42.309159 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.wsgi [None req-6f4c795c-c4b1-4bd5-934b-7db242a11e09 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] HTTP exception thrown: Instance 3cc866f4-91c1-4384-b88a-5866ca150aea could not be found. Sep 01 14:14:42.312923 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-6f4c795c-c4b1-4bd5-934b-7db242a11e09 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Request method failure captured: Sep 01 14:14:42.312923 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: request: GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea HTTP/1.1 Sep 01 14:14:42.312923 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept: application/json Sep 01 14:14:42.312923 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept-Encoding: identity Sep 01 14:14:42.312923 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Connection: close Sep 01 14:14:42.312923 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Length: 0 Sep 01 14:14:42.312923 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Type: application/json Sep 01 14:14:42.312923 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Host: 10.222.0.25 Sep 01 14:14:42.312923 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Openstack-System-Scope: None Sep 01 14:14:42.312923 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: User-Agent: python-urllib3/1.26.12 Sep 01 14:14:42.312923 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Auth-Token: gAAAAABjELztUtQ-VriG66eoS03GMPnoZo1TqeNw0cvdtVxAKPtMdMLqUeAU3wvz8KKu54fuiT6n1msINy2Vx58GFRcq0qBnXXn-2APnTPn1kTL-VT2RZTZGl7TRARPYLpVLz1VZSLcMI4npgb7CUfrcPukjbFBGcZ3E4rB-yPHJtM7SPTjur0M Sep 01 14:14:42.312923 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Id: None Sep 01 14:14:42.312923 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Name: None Sep 01 14:14:42.312923 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Identity-Status: Confirmed Sep 01 14:14:42.312923 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Is-Admin-Project: True Sep 01 14:14:42.312923 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Id: default Sep 01 14:14:42.312923 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Name: Default Sep 01 14:14:42.312923 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Id: c1c061b824cb4a92a469061e7a67f967 Sep 01 14:14:42.312923 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Name: tempest-TestShelveInstance-941148344 Sep 01 14:14:42.312923 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Role: member,reader Sep 01 14:14:42.312923 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Roles: member,reader Sep 01 14:14:42.315974 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c1c061b824cb4a92a469061e7a67f967"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/c1c061b824cb4a92a469061e7a67f967"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/c1c061b824cb4a92a469061e7a67f967"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_c1c061b824cb4a92a469061e7a67f967"}]}] Sep 01 14:14:42.315974 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant: tempest-TestShelveInstance-941148344 Sep 01 14:14:42.315974 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Id: c1c061b824cb4a92a469061e7a67f967 Sep 01 14:14:42.315974 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Name: tempest-TestShelveInstance-941148344 Sep 01 14:14:42.315974 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User: tempest-TestShelveInstance-941148344-project Sep 01 14:14:42.315974 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Id: default Sep 01 14:14:42.315974 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Name: Default Sep 01 14:14:42.315974 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Id: af1f81b83784472abc4b6ff4393afb7c Sep 01 14:14:42.315974 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Name: tempest-TestShelveInstance-941148344-project Sep 01 14:14:42.315974 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: method: > Sep 01 14:14:42.315974 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: exception: Instance 3cc866f4-91c1-4384-b88a-5866ca150aea could not be found. Sep 01 14:14:42.315974 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: action_args: {'id': '3cc866f4-91c1-4384-b88a-5866ca150aea'} Sep 01 14:14:42.317635 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:14:42.317635 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:14:42.317635 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:14:42.317635 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:14:42.317635 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:14:42.317635 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:14:42.317635 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:14:42.317635 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:14:42.317635 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:14:42.317635 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:14:42.317635 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cc866f4-91c1-4384-b88a-5866ca150aea could not be found. Sep 01 14:14:42.317635 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:14:42.317635 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:14:42.317635 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:14:42.317635 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:14:42.317635 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:14:42.317635 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:14:42.317635 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:14:42.317635 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:14:42.317635 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:14:42.320405 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:14:42.320405 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:14:42.320405 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:14:42.320405 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:14:42.320405 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:14:42.320405 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:14:42.320405 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:14:42.320405 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cc866f4-91c1-4384-b88a-5866ca150aea could not be found. Sep 01 14:14:42.320405 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:14:42.320405 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:14:42.320405 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:14:42.320405 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:14:42.320405 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:14:42.320405 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:14:42.320405 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:14:42.320405 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:14:42.320405 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cc866f4-91c1-4384-b88a-5866ca150aea could not be found. Sep 01 14:14:42.320405 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:14:42.327259 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-6f4c795c-c4b1-4bd5-934b-7db242a11e09 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Returning 404 to user: Instance 3cc866f4-91c1-4384-b88a-5866ca150aea could not be found. {{(pid=121339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:14:42.327259 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-6f4c795c-c4b1-4bd5-934b-7db242a11e09 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea" status: 404 len: 111 microversion: 2.1 time: 0.076867 Sep 01 14:14:42.327769 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 529/1064] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:14:42 2022] GET /compute/v2.1/servers/3cc866f4-91c1-4384-b88a-5866ca150aea => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:14:42.901381 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-54d865d0-2881-4156-a9b4-0ab034cbce31 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] Calling method '.version_select at 0x7f98679b0ee0>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:43.101454 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-54d865d0-2881-4156-a9b4-0ab034cbce31 tempest-TestShelveInstance-941148344 tempest-TestShelveInstance-941148344-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1433320455" status: 202 len: 0 microversion: 2.1 time: 0.210920 Sep 01 14:14:43.114203 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 536/1065] 10.222.0.25 () {58 vars in 1254 bytes} [Thu Sep 1 14:14:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1433320455 => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:14:50.931788 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-2663d811-1b01-4999-862a-c690ae3dbc45 tempest-VolumesTestJSON-760062850 tempest-VolumesTestJSON-760062850-project] Calling method '.version_select at 0x7f98679e2820>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:51.009504 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-2663d811-1b01-4999-862a-c690ae3dbc45 tempest-VolumesTestJSON-760062850 tempest-VolumesTestJSON-760062850-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/f1612579-202b-40a9-98ff-e58e76554555" status: 200 len: 350 microversion: 2.1 time: 0.081227 Sep 01 14:14:51.011457 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 530/1066] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 1 14:14:50 2022] GET /compute/v2.1/os-volumes/f1612579-202b-40a9-98ff-e58e76554555 => generated 350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:14:52.477074 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:14:52.482552 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-a8640465-923e-4e8f-9667-d3dabd642992 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:52.483176 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-a8640465-923e-4e8f-9667-d3dabd642992 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: f21e2730-924a-436f-a04b-ce7bc9b47ea9] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:52.493954 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a8640465-923e-4e8f-9667-d3dabd642992 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:52.494827 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a8640465-923e-4e8f-9667-d3dabd642992 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:52.496037 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a8640465-923e-4e8f-9667-d3dabd642992 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:52.498054 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a8640465-923e-4e8f-9667-d3dabd642992 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:52.498814 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a8640465-923e-4e8f-9667-d3dabd642992 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:52.499568 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a8640465-923e-4e8f-9667-d3dabd642992 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:52.681885 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.objects.instance [None req-a8640465-923e-4e8f-9667-d3dabd642992 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lazy-loading 'services' on Instance uuid f21e2730-924a-436f-a04b-ce7bc9b47ea9 {{(pid=121340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:14:52.953003 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-a8640465-923e-4e8f-9667-d3dabd642992 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9/os-volume_attachments/0aed1c9a-e42e-4ead-b759-cd05c561b577" status: 202 len: 0 microversion: 2.1 time: 0.476520 Sep 01 14:14:52.955395 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 537/1067] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Sep 1 14:14:52 2022] DELETE /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9/os-volume_attachments/0aed1c9a-e42e-4ead-b759-cd05c561b577 => generated 0 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 14:14:52.961848 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=2 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:14:52.962790 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:14:52.967631 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-0c9273d6-ef74-4f24-84a9-7bef34c68010 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:52.970295 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-0c9273d6-ef74-4f24-84a9-7bef34c68010 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: f21e2730-924a-436f-a04b-ce7bc9b47ea9] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:52.979078 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0c9273d6-ef74-4f24-84a9-7bef34c68010 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:52.980200 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0c9273d6-ef74-4f24-84a9-7bef34c68010 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:52.980763 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0c9273d6-ef74-4f24-84a9-7bef34c68010 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:52.981682 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0c9273d6-ef74-4f24-84a9-7bef34c68010 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:52.982449 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0c9273d6-ef74-4f24-84a9-7bef34c68010 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:52.983151 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0c9273d6-ef74-4f24-84a9-7bef34c68010 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:53.026354 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-0c9273d6-ef74-4f24-84a9-7bef34c68010 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066010 Sep 01 14:14:53.027841 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 531/1068] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 14:14:52 2022] GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:14:53.372302 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-92d21ab3-146f-4ae9-85f4-6341c24397da tempest-VolumesTestJSON-760062850 tempest-VolumesTestJSON-760062850-project] Calling method '.version_select at 0x7f986791c280>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:53.466064 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-92d21ab3-146f-4ae9-85f4-6341c24397da tempest-VolumesTestJSON-760062850 tempest-VolumesTestJSON-760062850-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/609ff098-70ab-4be6-9985-0aaa96d10b24" status: 200 len: 351 microversion: 2.1 time: 0.101608 Sep 01 14:14:53.480714 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 538/1069] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 1 14:14:53 2022] GET /compute/v2.1/os-volumes/609ff098-70ab-4be6-9985-0aaa96d10b24 => generated 351 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:14:54.048963 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-585d2c27-a3c9-417d-ab17-bc06c7356e08 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:54.052321 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-585d2c27-a3c9-417d-ab17-bc06c7356e08 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: f21e2730-924a-436f-a04b-ce7bc9b47ea9] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:54.076896 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-585d2c27-a3c9-417d-ab17-bc06c7356e08 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:54.077706 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-585d2c27-a3c9-417d-ab17-bc06c7356e08 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:54.078414 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-585d2c27-a3c9-417d-ab17-bc06c7356e08 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:54.080171 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-585d2c27-a3c9-417d-ab17-bc06c7356e08 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:54.081171 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-585d2c27-a3c9-417d-ab17-bc06c7356e08 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:54.081814 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-585d2c27-a3c9-417d-ab17-bc06c7356e08 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:54.144257 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-585d2c27-a3c9-417d-ab17-bc06c7356e08 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106698 Sep 01 14:14:54.146300 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 532/1070] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 14:14:54 2022] GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:14:55.160601 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-047bb81c-c0fb-4b3d-ace4-11091d82d5b5 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:55.163114 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-047bb81c-c0fb-4b3d-ace4-11091d82d5b5 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: f21e2730-924a-436f-a04b-ce7bc9b47ea9] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:55.172111 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-047bb81c-c0fb-4b3d-ace4-11091d82d5b5 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:55.172602 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-047bb81c-c0fb-4b3d-ace4-11091d82d5b5 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:55.173033 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-047bb81c-c0fb-4b3d-ace4-11091d82d5b5 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:55.173736 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-047bb81c-c0fb-4b3d-ace4-11091d82d5b5 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:55.174212 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-047bb81c-c0fb-4b3d-ace4-11091d82d5b5 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:55.174632 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-047bb81c-c0fb-4b3d-ace4-11091d82d5b5 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:55.208394 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-047bb81c-c0fb-4b3d-ace4-11091d82d5b5 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052072 Sep 01 14:14:55.215292 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 539/1071] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 14:14:55 2022] GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 14:14:55.290652 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-e6c5354e-e177-4305-a5c7-6c3223dc41a7 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:55.291608 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-e6c5354e-e177-4305-a5c7-6c3223dc41a7 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: f21e2730-924a-436f-a04b-ce7bc9b47ea9] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:55.301245 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e6c5354e-e177-4305-a5c7-6c3223dc41a7 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:55.302128 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e6c5354e-e177-4305-a5c7-6c3223dc41a7 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:55.302917 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e6c5354e-e177-4305-a5c7-6c3223dc41a7 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:55.304203 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e6c5354e-e177-4305-a5c7-6c3223dc41a7 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:55.305050 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e6c5354e-e177-4305-a5c7-6c3223dc41a7 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:55.305815 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e6c5354e-e177-4305-a5c7-6c3223dc41a7 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:55.353057 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-e6c5354e-e177-4305-a5c7-6c3223dc41a7 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: f21e2730-924a-436f-a04b-ce7bc9b47ea9] Going to try to terminate instance {{(pid=121339) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:14:56.021249 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-e6c5354e-e177-4305-a5c7-6c3223dc41a7 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9" status: 204 len: 0 microversion: 2.1 time: 0.734816 Sep 01 14:14:56.022135 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 533/1072] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 14:14:55 2022] DELETE /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9 => generated 0 bytes in 737 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:14:56.032184 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-38884aa6-ca6a-466c-aa1a-52580bfe2edc tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:56.032843 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-38884aa6-ca6a-466c-aa1a-52580bfe2edc tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: f21e2730-924a-436f-a04b-ce7bc9b47ea9] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:56.035736 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=2 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:14:56.042526 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-38884aa6-ca6a-466c-aa1a-52580bfe2edc tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:56.043109 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-38884aa6-ca6a-466c-aa1a-52580bfe2edc tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:56.043548 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-38884aa6-ca6a-466c-aa1a-52580bfe2edc tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:56.044279 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-38884aa6-ca6a-466c-aa1a-52580bfe2edc tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:56.044732 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-38884aa6-ca6a-466c-aa1a-52580bfe2edc tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:56.045195 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-38884aa6-ca6a-466c-aa1a-52580bfe2edc tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:56.228780 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-38884aa6-ca6a-466c-aa1a-52580bfe2edc tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:14:56.237775 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-38884aa6-ca6a-466c-aa1a-52580bfe2edc tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9" status: 200 len: 1681 microversion: 2.1 time: 0.210497 Sep 01 14:14:56.238539 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 540/1073] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:14:56 2022] GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9 => generated 1681 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:14:56.791043 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-2a30c1c2-a8f8-4e23-987d-20c32d0d6e9c tempest-VolumesTestJSON-760062850 tempest-VolumesTestJSON-760062850-project] Calling method '.version_select at 0x7f98679d89d0>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:56.856354 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-2a30c1c2-a8f8-4e23-987d-20c32d0d6e9c tempest-VolumesTestJSON-760062850 tempest-VolumesTestJSON-760062850-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/0e45538d-9329-4047-8590-853ae5a1be3e" status: 200 len: 351 microversion: 2.1 time: 0.069881 Sep 01 14:14:56.857115 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 534/1074] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 1 14:14:56 2022] GET /compute/v2.1/os-volumes/0e45538d-9329-4047-8590-853ae5a1be3e => generated 351 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:14:56.873397 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-dbd415cb-c5e4-49a4-a246-1c48b9d9e694 tempest-VolumesTestJSON-760062850 tempest-VolumesTestJSON-760062850-project] Calling method '.version_select at 0x7f9867ea4940>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:56.981288 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-dbd415cb-c5e4-49a4-a246-1c48b9d9e694 tempest-VolumesTestJSON-760062850 tempest-VolumesTestJSON-760062850-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.111348 Sep 01 14:14:56.982112 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 541/1075] 10.222.0.25 () {58 vars in 1134 bytes} [Thu Sep 1 14:14:56 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:14:56.999233 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-56a6b255-ee73-4014-ab50-9c093ec93618 tempest-VolumesTestJSON-760062850 tempest-VolumesTestJSON-760062850-project] Calling method '.version_select at 0x7f986797df70>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:57.097777 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-56a6b255-ee73-4014-ab50-9c093ec93618 tempest-VolumesTestJSON-760062850 tempest-VolumesTestJSON-760062850-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.102852 Sep 01 14:14:57.098557 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 535/1076] 10.222.0.25 () {58 vars in 1149 bytes} [Thu Sep 1 14:14:56 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:14:57.113316 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-e8b57f6d-039d-474c-b0a8-8933ec56410c tempest-VolumesTestJSON-760062850 tempest-VolumesTestJSON-760062850-project] Calling method '.version_select at 0x7f98678d5550>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:57.243044 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-e8b57f6d-039d-474c-b0a8-8933ec56410c tempest-VolumesTestJSON-760062850 tempest-VolumesTestJSON-760062850-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.133359 Sep 01 14:14:57.244340 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 542/1077] 10.222.0.25 () {58 vars in 1134 bytes} [Thu Sep 1 14:14:57 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:14:57.262241 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-cea24bab-88fa-4dd8-8217-5bbb986c43c1 tempest-VolumesTestJSON-760062850 tempest-VolumesTestJSON-760062850-project] Calling method '.version_select at 0x7f9867ac6430>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:57.271892 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-d6d2e494-abd0-4887-b744-57ee4df4485a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:57.272724 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-d6d2e494-abd0-4887-b744-57ee4df4485a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: f21e2730-924a-436f-a04b-ce7bc9b47ea9] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:57.295236 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d6d2e494-abd0-4887-b744-57ee4df4485a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:57.296324 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d6d2e494-abd0-4887-b744-57ee4df4485a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:57.297343 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d6d2e494-abd0-4887-b744-57ee4df4485a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:57.298822 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d6d2e494-abd0-4887-b744-57ee4df4485a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:57.299842 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d6d2e494-abd0-4887-b744-57ee4df4485a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:57.306009 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d6d2e494-abd0-4887-b744-57ee4df4485a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:57.440385 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-cea24bab-88fa-4dd8-8217-5bbb986c43c1 tempest-VolumesTestJSON-760062850 tempest-VolumesTestJSON-760062850-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.184106 Sep 01 14:14:57.441492 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 536/1078] 10.222.0.25 () {58 vars in 1167 bytes} [Thu Sep 1 14:14:57 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:14:57.459872 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-33bd91c7-6a4f-48a5-b81c-d0e453e5a825 tempest-VolumesTestJSON-760062850 tempest-VolumesTestJSON-760062850-project] Calling method '.version_select at 0x7f98679d8a60>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:57.562886 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-d6d2e494-abd0-4887-b744-57ee4df4485a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:14:57.591173 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-d6d2e494-abd0-4887-b744-57ee4df4485a tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9" status: 200 len: 1681 microversion: 2.1 time: 0.323371 Sep 01 14:14:57.592560 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 543/1079] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:14:57 2022] GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9 => generated 1681 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:14:57.630870 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-33bd91c7-6a4f-48a5-b81c-d0e453e5a825 tempest-VolumesTestJSON-760062850 tempest-VolumesTestJSON-760062850-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.176060 Sep 01 14:14:57.631601 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 537/1080] 10.222.0.25 () {58 vars in 1170 bytes} [Thu Sep 1 14:14:57 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:14:57.645798 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-e75399b4-92d7-4588-9b9d-8263c25678b0 tempest-VolumesTestJSON-760062850 tempest-VolumesTestJSON-760062850-project] Calling method '.version_select at 0x7f9867804f70>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:57.785367 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-e75399b4-92d7-4588-9b9d-8263c25678b0 tempest-VolumesTestJSON-760062850 tempest-VolumesTestJSON-760062850-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.143506 Sep 01 14:14:57.786525 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 544/1081] 10.222.0.25 () {58 vars in 1155 bytes} [Thu Sep 1 14:14:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:14:57.811048 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-2b8d89c6-e64f-402d-9ce8-6ebe6c3bfa83 tempest-VolumesTestJSON-760062850 tempest-VolumesTestJSON-760062850-project] Calling method '.version_select at 0x7f9867abce50>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:58.001529 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-2b8d89c6-e64f-402d-9ce8-6ebe6c3bfa83 tempest-VolumesTestJSON-760062850 tempest-VolumesTestJSON-760062850-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.197994 Sep 01 14:14:58.017082 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 538/1082] 10.222.0.25 () {58 vars in 1188 bytes} [Thu Sep 1 14:14:57 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:14:58.025611 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-9fc8c75d-8dca-4634-9b78-550029c684c9 tempest-VolumesTestJSON-760062850 tempest-VolumesTestJSON-760062850-project] Calling method '.version_select at 0x7f9867ea4430>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:58.138140 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-9fc8c75d-8dca-4634-9b78-550029c684c9 tempest-VolumesTestJSON-760062850 tempest-VolumesTestJSON-760062850-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.118451 Sep 01 14:14:58.138770 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 545/1083] 10.222.0.25 () {58 vars in 1155 bytes} [Thu Sep 1 14:14:58 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:14:58.628874 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-12f4be59-362c-41c8-b705-1d527d546abf tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:58.630240 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-12f4be59-362c-41c8-b705-1d527d546abf tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: f21e2730-924a-436f-a04b-ce7bc9b47ea9] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:58.639240 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-12f4be59-362c-41c8-b705-1d527d546abf tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:58.639755 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-12f4be59-362c-41c8-b705-1d527d546abf tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:58.651978 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-12f4be59-362c-41c8-b705-1d527d546abf tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:58.651978 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-12f4be59-362c-41c8-b705-1d527d546abf tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:58.651978 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-12f4be59-362c-41c8-b705-1d527d546abf tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:58.651978 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-12f4be59-362c-41c8-b705-1d527d546abf tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:58.842300 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-12f4be59-362c-41c8-b705-1d527d546abf tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:14:58.857163 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-12f4be59-362c-41c8-b705-1d527d546abf tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9" status: 200 len: 1681 microversion: 2.1 time: 0.232866 Sep 01 14:14:58.870410 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 539/1084] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:14:58 2022] GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9 => generated 1681 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:14:59.346105 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [req-e4a94ddc-b7e0-4e04-b60b-f3632d562ed0 req-5604c555-f149-48ca-b339-bbb422c0eda0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f21e2730-924a-436f-a04b-ce7bc9b47ea9", "name": "network-vif-deleted", "tag": "21f0cea4-2894-4114-a667-cf4f7590ef92"}]} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:14:59.370735 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-e4a94ddc-b7e0-4e04-b60b-f3632d562ed0 req-5604c555-f149-48ca-b339-bbb422c0eda0 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:59.371661 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-e4a94ddc-b7e0-4e04-b60b-f3632d562ed0 req-5604c555-f149-48ca-b339-bbb422c0eda0 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:59.372413 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-e4a94ddc-b7e0-4e04-b60b-f3632d562ed0 req-5604c555-f149-48ca-b339-bbb422c0eda0 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:59.396922 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.compute.server_external_events [req-e4a94ddc-b7e0-4e04-b60b-f3632d562ed0 req-5604c555-f149-48ca-b339-bbb422c0eda0 service nova] Creating event network-vif-deleted:21f0cea4-2894-4114-a667-cf4f7590ef92 for instance f21e2730-924a-436f-a04b-ce7bc9b47ea9 on hv-cinder-85221 Sep 01 14:14:59.414519 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [req-e4a94ddc-b7e0-4e04-b60b-f3632d562ed0 req-5604c555-f149-48ca-b339-bbb422c0eda0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072698 Sep 01 14:14:59.414519 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 546/1085] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:14:59.896282 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-4c313235-32e5-47e4-8b6a-9c4814856268 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:59.897517 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-4c313235-32e5-47e4-8b6a-9c4814856268 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: f21e2730-924a-436f-a04b-ce7bc9b47ea9] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:59.906971 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4c313235-32e5-47e4-8b6a-9c4814856268 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:59.907729 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4c313235-32e5-47e4-8b6a-9c4814856268 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:59.908252 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4c313235-32e5-47e4-8b6a-9c4814856268 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:59.909076 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4c313235-32e5-47e4-8b6a-9c4814856268 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:59.909823 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4c313235-32e5-47e4-8b6a-9c4814856268 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:59.910316 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4c313235-32e5-47e4-8b6a-9c4814856268 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:59.967265 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4c313235-32e5-47e4-8b6a-9c4814856268 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:59.967750 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4c313235-32e5-47e4-8b6a-9c4814856268 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:59.968185 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-4c313235-32e5-47e4-8b6a-9c4814856268 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:59.968635 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.objects.instance [None req-4c313235-32e5-47e4-8b6a-9c4814856268 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lazy-loading 'fault' on Instance uuid f21e2730-924a-436f-a04b-ce7bc9b47ea9 {{(pid=121339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:15:00.048499 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-4c313235-32e5-47e4-8b6a-9c4814856268 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ae66df61a764a42a1b1b15f54d5c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90a84500a899479aabfa3aeb72b4c4ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:15:00.062725 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-4c313235-32e5-47e4-8b6a-9c4814856268 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9" status: 200 len: 1331 microversion: 2.1 time: 0.170569 Sep 01 14:15:00.063840 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 540/1086] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:14:59 2022] GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9 => generated 1331 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:15:01.097223 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-b9b29c65-11d0-49cd-83f8-2f9936787c15 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:15:01.098428 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-b9b29c65-11d0-49cd-83f8-2f9936787c15 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: f21e2730-924a-436f-a04b-ce7bc9b47ea9] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:15:01.119005 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b9b29c65-11d0-49cd-83f8-2f9936787c15 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:01.119630 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b9b29c65-11d0-49cd-83f8-2f9936787c15 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:01.120970 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b9b29c65-11d0-49cd-83f8-2f9936787c15 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:01.121855 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b9b29c65-11d0-49cd-83f8-2f9936787c15 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:01.122669 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b9b29c65-11d0-49cd-83f8-2f9936787c15 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:01.123248 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b9b29c65-11d0-49cd-83f8-2f9936787c15 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:01.142572 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.wsgi [None req-b9b29c65-11d0-49cd-83f8-2f9936787c15 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] HTTP exception thrown: Instance f21e2730-924a-436f-a04b-ce7bc9b47ea9 could not be found. Sep 01 14:15:01.144274 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-b9b29c65-11d0-49cd-83f8-2f9936787c15 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Request method failure captured: Sep 01 14:15:01.144274 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: request: GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9 HTTP/1.1 Sep 01 14:15:01.144274 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept: application/json Sep 01 14:15:01.144274 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept-Encoding: identity Sep 01 14:15:01.144274 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Connection: close Sep 01 14:15:01.144274 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Length: 0 Sep 01 14:15:01.144274 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Type: application/json Sep 01 14:15:01.144274 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Host: 10.222.0.25 Sep 01 14:15:01.144274 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Openstack-System-Scope: None Sep 01 14:15:01.144274 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: User-Agent: python-urllib3/1.26.12 Sep 01 14:15:01.144274 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Auth-Token: gAAAAABjELyhZj5Hr9I4grX9g-sLmSzxOFwV6C8_UuPsJu0TTboeG4lPJ1EtlgmTO6Q18ohdm_zKgQxmrLRlDi5SpU-ZjSVzLIRa5u6LBsCTR0TutJimllLkII0Ts1UxHVT4475s7UI-5uK5aNVzYOSUMxaGRq9ZaCGPwi2wkROzwm6JUQLDfLI Sep 01 14:15:01.144274 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Id: None Sep 01 14:15:01.144274 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Name: None Sep 01 14:15:01.144274 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Identity-Status: Confirmed Sep 01 14:15:01.144274 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Is-Admin-Project: True Sep 01 14:15:01.144274 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Id: default Sep 01 14:15:01.144274 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Name: Default Sep 01 14:15:01.144274 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Id: 90a84500a899479aabfa3aeb72b4c4ae Sep 01 14:15:01.144274 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Name: tempest-AttachVolumeNegativeTest-836381067 Sep 01 14:15:01.144274 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Role: member,reader Sep 01 14:15:01.144274 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Roles: member,reader Sep 01 14:15:01.146741 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/90a84500a899479aabfa3aeb72b4c4ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/90a84500a899479aabfa3aeb72b4c4ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/90a84500a899479aabfa3aeb72b4c4ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_90a84500a899479aabfa3aeb72b4c4ae"}]}] Sep 01 14:15:01.146741 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant: tempest-AttachVolumeNegativeTest-836381067 Sep 01 14:15:01.146741 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Id: 90a84500a899479aabfa3aeb72b4c4ae Sep 01 14:15:01.146741 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-836381067 Sep 01 14:15:01.146741 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User: tempest-AttachVolumeNegativeTest-836381067-project Sep 01 14:15:01.146741 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Id: default Sep 01 14:15:01.146741 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Name: Default Sep 01 14:15:01.146741 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Id: 7ae66df61a764a42a1b1b15f54d5c34b Sep 01 14:15:01.146741 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Name: tempest-AttachVolumeNegativeTest-836381067-project Sep 01 14:15:01.146741 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: method: > Sep 01 14:15:01.146741 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: exception: Instance f21e2730-924a-436f-a04b-ce7bc9b47ea9 could not be found. Sep 01 14:15:01.146741 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: action_args: {'id': 'f21e2730-924a-436f-a04b-ce7bc9b47ea9'} Sep 01 14:15:01.148072 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:15:01.148072 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:01.148072 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:15:01.148072 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:15:01.148072 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:15:01.148072 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:15:01.148072 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:15:01.148072 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:15:01.148072 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:15:01.148072 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:15:01.148072 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f21e2730-924a-436f-a04b-ce7bc9b47ea9 could not be found. Sep 01 14:15:01.148072 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:15:01.148072 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:15:01.148072 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:15:01.148072 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:01.148072 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:15:01.148072 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:15:01.148072 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:15:01.148072 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:15:01.148072 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:15:01.150739 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:15:01.150739 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:15:01.150739 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:15:01.150739 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:15:01.150739 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:15:01.150739 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:15:01.150739 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:15:01.150739 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f21e2730-924a-436f-a04b-ce7bc9b47ea9 could not be found. Sep 01 14:15:01.150739 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:15:01.150739 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:15:01.150739 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:15:01.150739 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:01.150739 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:15:01.150739 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:15:01.150739 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:15:01.150739 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:15:01.150739 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f21e2730-924a-436f-a04b-ce7bc9b47ea9 could not be found. Sep 01 14:15:01.150739 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:15:01.153682 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-b9b29c65-11d0-49cd-83f8-2f9936787c15 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Returning 404 to user: Instance f21e2730-924a-436f-a04b-ce7bc9b47ea9 could not be found. {{(pid=121340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:15:01.153682 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-b9b29c65-11d0-49cd-83f8-2f9936787c15 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9" status: 404 len: 111 microversion: 2.1 time: 0.058385 Sep 01 14:15:01.153682 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 547/1087] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:15:01 2022] GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 14:15:01.159612 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-c5bd5e78-b57a-4e9c-b1de-5bf1d28b6de1 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '.version_select at 0x7f9867a61ca0>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:15:01.256224 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-c5bd5e78-b57a-4e9c-b1de-5bf1d28b6de1 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-397073497" status: 202 len: 0 microversion: 2.1 time: 0.095693 Sep 01 14:15:01.256224 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 541/1088] 10.222.0.25 () {58 vars in 1218 bytes} [Thu Sep 1 14:15:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-397073497 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:15:03.743772 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-47698f3c-cfe7-4204-8abe-b03b1d90bd99 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:15:03.745478 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-47698f3c-cfe7-4204-8abe-b03b1d90bd99 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: f21e2730-924a-436f-a04b-ce7bc9b47ea9] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:15:03.753346 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-47698f3c-cfe7-4204-8abe-b03b1d90bd99 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:03.755570 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-47698f3c-cfe7-4204-8abe-b03b1d90bd99 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:03.761979 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-47698f3c-cfe7-4204-8abe-b03b1d90bd99 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:03.761979 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-47698f3c-cfe7-4204-8abe-b03b1d90bd99 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:03.761979 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-47698f3c-cfe7-4204-8abe-b03b1d90bd99 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:03.761979 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-47698f3c-cfe7-4204-8abe-b03b1d90bd99 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:03.791275 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.wsgi [None req-47698f3c-cfe7-4204-8abe-b03b1d90bd99 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] HTTP exception thrown: Instance f21e2730-924a-436f-a04b-ce7bc9b47ea9 could not be found. Sep 01 14:15:03.794474 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-47698f3c-cfe7-4204-8abe-b03b1d90bd99 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Request method failure captured: Sep 01 14:15:03.794474 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: request: DELETE /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9 HTTP/1.1 Sep 01 14:15:03.794474 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept: application/json Sep 01 14:15:03.794474 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept-Encoding: identity Sep 01 14:15:03.794474 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Connection: close Sep 01 14:15:03.794474 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Length: 0 Sep 01 14:15:03.794474 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Type: application/json Sep 01 14:15:03.794474 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Host: 10.222.0.25 Sep 01 14:15:03.794474 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Openstack-System-Scope: None Sep 01 14:15:03.794474 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: User-Agent: python-urllib3/1.26.12 Sep 01 14:15:03.794474 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Auth-Token: gAAAAABjELyhZj5Hr9I4grX9g-sLmSzxOFwV6C8_UuPsJu0TTboeG4lPJ1EtlgmTO6Q18ohdm_zKgQxmrLRlDi5SpU-ZjSVzLIRa5u6LBsCTR0TutJimllLkII0Ts1UxHVT4475s7UI-5uK5aNVzYOSUMxaGRq9ZaCGPwi2wkROzwm6JUQLDfLI Sep 01 14:15:03.794474 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Id: None Sep 01 14:15:03.794474 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Name: None Sep 01 14:15:03.794474 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Identity-Status: Confirmed Sep 01 14:15:03.794474 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Is-Admin-Project: True Sep 01 14:15:03.794474 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Id: default Sep 01 14:15:03.794474 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Name: Default Sep 01 14:15:03.794474 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Id: 90a84500a899479aabfa3aeb72b4c4ae Sep 01 14:15:03.794474 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Name: tempest-AttachVolumeNegativeTest-836381067 Sep 01 14:15:03.794474 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Role: member,reader Sep 01 14:15:03.794474 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Roles: member,reader Sep 01 14:15:03.796831 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/90a84500a899479aabfa3aeb72b4c4ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/90a84500a899479aabfa3aeb72b4c4ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/90a84500a899479aabfa3aeb72b4c4ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_90a84500a899479aabfa3aeb72b4c4ae"}]}] Sep 01 14:15:03.796831 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant: tempest-AttachVolumeNegativeTest-836381067 Sep 01 14:15:03.796831 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Id: 90a84500a899479aabfa3aeb72b4c4ae Sep 01 14:15:03.796831 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-836381067 Sep 01 14:15:03.796831 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User: tempest-AttachVolumeNegativeTest-836381067-project Sep 01 14:15:03.796831 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Id: default Sep 01 14:15:03.796831 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Name: Default Sep 01 14:15:03.796831 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Id: 7ae66df61a764a42a1b1b15f54d5c34b Sep 01 14:15:03.796831 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Name: tempest-AttachVolumeNegativeTest-836381067-project Sep 01 14:15:03.796831 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: method: > Sep 01 14:15:03.796831 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: exception: Instance f21e2730-924a-436f-a04b-ce7bc9b47ea9 could not be found. Sep 01 14:15:03.796831 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: action_args: {'id': 'f21e2730-924a-436f-a04b-ce7bc9b47ea9'} Sep 01 14:15:03.798637 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:15:03.798637 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:03.798637 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:15:03.798637 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:15:03.798637 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:15:03.798637 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:15:03.798637 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:15:03.798637 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:15:03.798637 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:15:03.798637 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:15:03.798637 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f21e2730-924a-436f-a04b-ce7bc9b47ea9 could not be found. Sep 01 14:15:03.798637 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:15:03.798637 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:15:03.798637 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:15:03.798637 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:03.798637 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:15:03.798637 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:15:03.798637 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:15:03.798637 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:15:03.798637 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:15:03.807229 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:15:03.807229 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 14:15:03.807229 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 14:15:03.807229 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 14:15:03.807229 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 14:15:03.807229 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:15:03.807229 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:15:03.807229 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:15:03.807229 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:15:03.807229 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f21e2730-924a-436f-a04b-ce7bc9b47ea9 could not be found. Sep 01 14:15:03.807229 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:15:03.807229 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:15:03.807229 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:15:03.807229 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:03.807229 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:15:03.807229 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:15:03.807229 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:15:03.807229 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:15:03.807229 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f21e2730-924a-436f-a04b-ce7bc9b47ea9 could not be found. Sep 01 14:15:03.807229 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:15:03.819869 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-47698f3c-cfe7-4204-8abe-b03b1d90bd99 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Returning 404 to user: Instance f21e2730-924a-436f-a04b-ce7bc9b47ea9 could not be found. {{(pid=121340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:15:03.819869 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-47698f3c-cfe7-4204-8abe-b03b1d90bd99 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9" status: 404 len: 111 microversion: 2.1 time: 0.058469 Sep 01 14:15:03.819869 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 548/1089] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 14:15:03 2022] DELETE /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:15:03.827557 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-b1dc9306-2b2f-4c3c-bd8a-5c7e763ee449 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:15:03.829220 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-b1dc9306-2b2f-4c3c-bd8a-5c7e763ee449 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: f21e2730-924a-436f-a04b-ce7bc9b47ea9] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:15:03.845675 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b1dc9306-2b2f-4c3c-bd8a-5c7e763ee449 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:03.846835 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b1dc9306-2b2f-4c3c-bd8a-5c7e763ee449 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:03.847996 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b1dc9306-2b2f-4c3c-bd8a-5c7e763ee449 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:03.850094 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b1dc9306-2b2f-4c3c-bd8a-5c7e763ee449 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:03.850841 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b1dc9306-2b2f-4c3c-bd8a-5c7e763ee449 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:03.851499 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b1dc9306-2b2f-4c3c-bd8a-5c7e763ee449 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:03.876613 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.wsgi [None req-b1dc9306-2b2f-4c3c-bd8a-5c7e763ee449 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] HTTP exception thrown: Instance f21e2730-924a-436f-a04b-ce7bc9b47ea9 could not be found. Sep 01 14:15:03.876613 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-b1dc9306-2b2f-4c3c-bd8a-5c7e763ee449 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Request method failure captured: Sep 01 14:15:03.876613 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: request: GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9 HTTP/1.1 Sep 01 14:15:03.876613 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept: application/json Sep 01 14:15:03.876613 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept-Encoding: identity Sep 01 14:15:03.876613 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Connection: close Sep 01 14:15:03.876613 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Length: 0 Sep 01 14:15:03.876613 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Type: application/json Sep 01 14:15:03.876613 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Host: 10.222.0.25 Sep 01 14:15:03.876613 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Openstack-System-Scope: None Sep 01 14:15:03.876613 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: User-Agent: python-urllib3/1.26.12 Sep 01 14:15:03.876613 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Auth-Token: gAAAAABjELyhZj5Hr9I4grX9g-sLmSzxOFwV6C8_UuPsJu0TTboeG4lPJ1EtlgmTO6Q18ohdm_zKgQxmrLRlDi5SpU-ZjSVzLIRa5u6LBsCTR0TutJimllLkII0Ts1UxHVT4475s7UI-5uK5aNVzYOSUMxaGRq9ZaCGPwi2wkROzwm6JUQLDfLI Sep 01 14:15:03.876613 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Id: None Sep 01 14:15:03.876613 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Name: None Sep 01 14:15:03.876613 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Identity-Status: Confirmed Sep 01 14:15:03.876613 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Is-Admin-Project: True Sep 01 14:15:03.876613 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Id: default Sep 01 14:15:03.876613 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Name: Default Sep 01 14:15:03.876613 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Id: 90a84500a899479aabfa3aeb72b4c4ae Sep 01 14:15:03.876613 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Name: tempest-AttachVolumeNegativeTest-836381067 Sep 01 14:15:03.876613 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Role: member,reader Sep 01 14:15:03.876613 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Roles: member,reader Sep 01 14:15:03.880053 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/90a84500a899479aabfa3aeb72b4c4ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/90a84500a899479aabfa3aeb72b4c4ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/90a84500a899479aabfa3aeb72b4c4ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_90a84500a899479aabfa3aeb72b4c4ae"}]}] Sep 01 14:15:03.880053 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant: tempest-AttachVolumeNegativeTest-836381067 Sep 01 14:15:03.880053 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Id: 90a84500a899479aabfa3aeb72b4c4ae Sep 01 14:15:03.880053 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-836381067 Sep 01 14:15:03.880053 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User: tempest-AttachVolumeNegativeTest-836381067-project Sep 01 14:15:03.880053 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Id: default Sep 01 14:15:03.880053 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Name: Default Sep 01 14:15:03.880053 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Id: 7ae66df61a764a42a1b1b15f54d5c34b Sep 01 14:15:03.880053 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Name: tempest-AttachVolumeNegativeTest-836381067-project Sep 01 14:15:03.880053 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: method: > Sep 01 14:15:03.880053 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: exception: Instance f21e2730-924a-436f-a04b-ce7bc9b47ea9 could not be found. Sep 01 14:15:03.880053 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: action_args: {'id': 'f21e2730-924a-436f-a04b-ce7bc9b47ea9'} Sep 01 14:15:03.882998 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:15:03.882998 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:03.882998 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:15:03.882998 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:15:03.882998 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:15:03.882998 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:15:03.882998 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:15:03.882998 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:15:03.882998 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:15:03.882998 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:15:03.882998 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f21e2730-924a-436f-a04b-ce7bc9b47ea9 could not be found. Sep 01 14:15:03.882998 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:15:03.882998 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:15:03.882998 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:15:03.882998 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:03.882998 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:15:03.882998 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:15:03.882998 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:15:03.882998 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:15:03.882998 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:15:03.890672 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:15:03.890672 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:15:03.890672 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:15:03.890672 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:15:03.890672 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:15:03.890672 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:15:03.890672 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:15:03.890672 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f21e2730-924a-436f-a04b-ce7bc9b47ea9 could not be found. Sep 01 14:15:03.890672 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:15:03.890672 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:15:03.890672 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:15:03.890672 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:03.890672 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:15:03.890672 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:15:03.890672 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:15:03.890672 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:15:03.890672 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f21e2730-924a-436f-a04b-ce7bc9b47ea9 could not be found. Sep 01 14:15:03.890672 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:15:03.893531 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-b1dc9306-2b2f-4c3c-bd8a-5c7e763ee449 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Returning 404 to user: Instance f21e2730-924a-436f-a04b-ce7bc9b47ea9 could not be found. {{(pid=121339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:15:03.893531 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-b1dc9306-2b2f-4c3c-bd8a-5c7e763ee449 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9" status: 404 len: 111 microversion: 2.1 time: 0.065588 Sep 01 14:15:03.893531 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 542/1090] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:15:03 2022] GET /compute/v2.1/servers/f21e2730-924a-436f-a04b-ce7bc9b47ea9 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:15:05.409744 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-5a144da2-519b-48e9-b6c0-593ef803738b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:15:05.409744 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-5a144da2-519b-48e9-b6c0-593ef803738b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:15:05.416158 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5a144da2-519b-48e9-b6c0-593ef803738b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:05.417286 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5a144da2-519b-48e9-b6c0-593ef803738b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:05.418051 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5a144da2-519b-48e9-b6c0-593ef803738b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:05.418812 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5a144da2-519b-48e9-b6c0-593ef803738b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:05.419284 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5a144da2-519b-48e9-b6c0-593ef803738b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:05.419720 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-5a144da2-519b-48e9-b6c0-593ef803738b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:05.437248 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.wsgi [None req-5a144da2-519b-48e9-b6c0-593ef803738b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] HTTP exception thrown: Instance 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce could not be found. Sep 01 14:15:05.439137 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-5a144da2-519b-48e9-b6c0-593ef803738b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Request method failure captured: Sep 01 14:15:05.439137 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: request: DELETE /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce HTTP/1.1 Sep 01 14:15:05.439137 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept: application/json Sep 01 14:15:05.439137 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept-Encoding: identity Sep 01 14:15:05.439137 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Connection: close Sep 01 14:15:05.439137 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Length: 0 Sep 01 14:15:05.439137 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Type: application/json Sep 01 14:15:05.439137 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Host: 10.222.0.25 Sep 01 14:15:05.439137 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Openstack-System-Scope: None Sep 01 14:15:05.439137 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: User-Agent: python-urllib3/1.26.12 Sep 01 14:15:05.439137 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Auth-Token: gAAAAABjELyhZj5Hr9I4grX9g-sLmSzxOFwV6C8_UuPsJu0TTboeG4lPJ1EtlgmTO6Q18ohdm_zKgQxmrLRlDi5SpU-ZjSVzLIRa5u6LBsCTR0TutJimllLkII0Ts1UxHVT4475s7UI-5uK5aNVzYOSUMxaGRq9ZaCGPwi2wkROzwm6JUQLDfLI Sep 01 14:15:05.439137 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Id: None Sep 01 14:15:05.439137 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Name: None Sep 01 14:15:05.439137 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Identity-Status: Confirmed Sep 01 14:15:05.439137 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Is-Admin-Project: True Sep 01 14:15:05.439137 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Id: default Sep 01 14:15:05.439137 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Name: Default Sep 01 14:15:05.439137 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Id: 90a84500a899479aabfa3aeb72b4c4ae Sep 01 14:15:05.439137 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Name: tempest-AttachVolumeNegativeTest-836381067 Sep 01 14:15:05.439137 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Role: member,reader Sep 01 14:15:05.439137 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Roles: member,reader Sep 01 14:15:05.441420 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/90a84500a899479aabfa3aeb72b4c4ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/90a84500a899479aabfa3aeb72b4c4ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/90a84500a899479aabfa3aeb72b4c4ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_90a84500a899479aabfa3aeb72b4c4ae"}]}] Sep 01 14:15:05.441420 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant: tempest-AttachVolumeNegativeTest-836381067 Sep 01 14:15:05.441420 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Id: 90a84500a899479aabfa3aeb72b4c4ae Sep 01 14:15:05.441420 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-836381067 Sep 01 14:15:05.441420 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User: tempest-AttachVolumeNegativeTest-836381067-project Sep 01 14:15:05.441420 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Id: default Sep 01 14:15:05.441420 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Name: Default Sep 01 14:15:05.441420 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Id: 7ae66df61a764a42a1b1b15f54d5c34b Sep 01 14:15:05.441420 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Name: tempest-AttachVolumeNegativeTest-836381067-project Sep 01 14:15:05.441420 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: method: > Sep 01 14:15:05.441420 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: exception: Instance 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce could not be found. Sep 01 14:15:05.441420 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: action_args: {'id': '7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce'} Sep 01 14:15:05.442782 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:15:05.442782 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:05.442782 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:15:05.442782 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:15:05.442782 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:15:05.442782 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:15:05.442782 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:15:05.442782 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:15:05.442782 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:15:05.442782 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:15:05.442782 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce could not be found. Sep 01 14:15:05.442782 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:15:05.442782 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:15:05.442782 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:15:05.442782 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:05.442782 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:15:05.442782 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:15:05.442782 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:15:05.442782 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:15:05.442782 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:15:05.445036 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:15:05.445036 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 14:15:05.445036 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 14:15:05.445036 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 14:15:05.445036 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 14:15:05.445036 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:15:05.445036 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:15:05.445036 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:15:05.445036 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:15:05.445036 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce could not be found. Sep 01 14:15:05.445036 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:15:05.445036 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:15:05.445036 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:15:05.445036 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:05.445036 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:15:05.445036 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:15:05.445036 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:15:05.445036 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:15:05.445036 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce could not be found. Sep 01 14:15:05.445036 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:15:05.447424 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-5a144da2-519b-48e9-b6c0-593ef803738b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Returning 404 to user: Instance 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce could not be found. {{(pid=121340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:15:05.447424 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-5a144da2-519b-48e9-b6c0-593ef803738b tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce" status: 404 len: 111 microversion: 2.1 time: 0.037608 Sep 01 14:15:05.447424 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 549/1091] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 14:15:05 2022] DELETE /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:15:05.449985 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-706f2a8b-4732-4089-ae48-d561d4a626f8 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:15:05.450605 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-706f2a8b-4732-4089-ae48-d561d4a626f8 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:15:05.458196 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-706f2a8b-4732-4089-ae48-d561d4a626f8 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:05.458674 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-706f2a8b-4732-4089-ae48-d561d4a626f8 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:05.459117 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-706f2a8b-4732-4089-ae48-d561d4a626f8 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:05.459849 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-706f2a8b-4732-4089-ae48-d561d4a626f8 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:05.460310 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-706f2a8b-4732-4089-ae48-d561d4a626f8 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:05.460822 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-706f2a8b-4732-4089-ae48-d561d4a626f8 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:05.477016 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.wsgi [None req-706f2a8b-4732-4089-ae48-d561d4a626f8 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] HTTP exception thrown: Instance 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce could not be found. Sep 01 14:15:05.478754 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-706f2a8b-4732-4089-ae48-d561d4a626f8 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Request method failure captured: Sep 01 14:15:05.478754 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: request: GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce HTTP/1.1 Sep 01 14:15:05.478754 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept: application/json Sep 01 14:15:05.478754 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept-Encoding: identity Sep 01 14:15:05.478754 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Connection: close Sep 01 14:15:05.478754 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Length: 0 Sep 01 14:15:05.478754 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Type: application/json Sep 01 14:15:05.478754 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Host: 10.222.0.25 Sep 01 14:15:05.478754 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Openstack-System-Scope: None Sep 01 14:15:05.478754 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: User-Agent: python-urllib3/1.26.12 Sep 01 14:15:05.478754 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Auth-Token: gAAAAABjELyhZj5Hr9I4grX9g-sLmSzxOFwV6C8_UuPsJu0TTboeG4lPJ1EtlgmTO6Q18ohdm_zKgQxmrLRlDi5SpU-ZjSVzLIRa5u6LBsCTR0TutJimllLkII0Ts1UxHVT4475s7UI-5uK5aNVzYOSUMxaGRq9ZaCGPwi2wkROzwm6JUQLDfLI Sep 01 14:15:05.478754 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Id: None Sep 01 14:15:05.478754 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Name: None Sep 01 14:15:05.478754 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Identity-Status: Confirmed Sep 01 14:15:05.478754 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Is-Admin-Project: True Sep 01 14:15:05.478754 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Id: default Sep 01 14:15:05.478754 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Name: Default Sep 01 14:15:05.478754 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Id: 90a84500a899479aabfa3aeb72b4c4ae Sep 01 14:15:05.478754 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Name: tempest-AttachVolumeNegativeTest-836381067 Sep 01 14:15:05.478754 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Role: member,reader Sep 01 14:15:05.478754 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Roles: member,reader Sep 01 14:15:05.482009 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/90a84500a899479aabfa3aeb72b4c4ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/90a84500a899479aabfa3aeb72b4c4ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/90a84500a899479aabfa3aeb72b4c4ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_90a84500a899479aabfa3aeb72b4c4ae"}]}] Sep 01 14:15:05.482009 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant: tempest-AttachVolumeNegativeTest-836381067 Sep 01 14:15:05.482009 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Id: 90a84500a899479aabfa3aeb72b4c4ae Sep 01 14:15:05.482009 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-836381067 Sep 01 14:15:05.482009 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User: tempest-AttachVolumeNegativeTest-836381067-project Sep 01 14:15:05.482009 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Id: default Sep 01 14:15:05.482009 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Name: Default Sep 01 14:15:05.482009 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Id: 7ae66df61a764a42a1b1b15f54d5c34b Sep 01 14:15:05.482009 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Name: tempest-AttachVolumeNegativeTest-836381067-project Sep 01 14:15:05.482009 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: method: > Sep 01 14:15:05.482009 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: exception: Instance 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce could not be found. Sep 01 14:15:05.482009 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: action_args: {'id': '7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce'} Sep 01 14:15:05.483377 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:15:05.483377 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:05.483377 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:15:05.483377 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:15:05.483377 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:15:05.483377 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:15:05.483377 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:15:05.483377 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:15:05.483377 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:15:05.483377 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:15:05.483377 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce could not be found. Sep 01 14:15:05.483377 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:15:05.483377 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:15:05.483377 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:15:05.483377 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:05.483377 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:15:05.483377 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:15:05.483377 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:15:05.483377 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:15:05.483377 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:15:05.485832 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:15:05.485832 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:15:05.485832 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:15:05.485832 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:15:05.485832 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:15:05.485832 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:15:05.485832 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:15:05.485832 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce could not be found. Sep 01 14:15:05.485832 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:15:05.485832 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:15:05.485832 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:15:05.485832 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:05.485832 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:15:05.485832 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:15:05.485832 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:15:05.485832 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:15:05.485832 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce could not be found. Sep 01 14:15:05.485832 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:15:05.487894 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-706f2a8b-4732-4089-ae48-d561d4a626f8 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Returning 404 to user: Instance 7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce could not be found. {{(pid=121339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:15:05.487894 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-706f2a8b-4732-4089-ae48-d561d4a626f8 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce" status: 404 len: 111 microversion: 2.1 time: 0.037097 Sep 01 14:15:05.487894 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 543/1092] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:15:05 2022] GET /compute/v2.1/servers/7ba40a37-c6d7-4a85-8fd9-a7cc63bf46ce => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:15:05.498589 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-a9fa5aac-47e6-41c8-b7fb-b9d4a55468b3 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:15:05.499772 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-a9fa5aac-47e6-41c8-b7fb-b9d4a55468b3 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 3e82006c-11f2-43d8-b929-e161f9c506d4] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:15:05.513946 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a9fa5aac-47e6-41c8-b7fb-b9d4a55468b3 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:05.514438 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a9fa5aac-47e6-41c8-b7fb-b9d4a55468b3 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:05.514878 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a9fa5aac-47e6-41c8-b7fb-b9d4a55468b3 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:05.515722 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a9fa5aac-47e6-41c8-b7fb-b9d4a55468b3 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:05.516138 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a9fa5aac-47e6-41c8-b7fb-b9d4a55468b3 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:05.516446 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a9fa5aac-47e6-41c8-b7fb-b9d4a55468b3 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:05.531831 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.wsgi [None req-a9fa5aac-47e6-41c8-b7fb-b9d4a55468b3 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] HTTP exception thrown: Instance 3e82006c-11f2-43d8-b929-e161f9c506d4 could not be found. Sep 01 14:15:05.533464 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-a9fa5aac-47e6-41c8-b7fb-b9d4a55468b3 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Request method failure captured: Sep 01 14:15:05.533464 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: request: DELETE /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4 HTTP/1.1 Sep 01 14:15:05.533464 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept: application/json Sep 01 14:15:05.533464 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept-Encoding: identity Sep 01 14:15:05.533464 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Connection: close Sep 01 14:15:05.533464 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Length: 0 Sep 01 14:15:05.533464 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Type: application/json Sep 01 14:15:05.533464 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Host: 10.222.0.25 Sep 01 14:15:05.533464 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Openstack-System-Scope: None Sep 01 14:15:05.533464 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: User-Agent: python-urllib3/1.26.12 Sep 01 14:15:05.533464 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Auth-Token: gAAAAABjELyhZj5Hr9I4grX9g-sLmSzxOFwV6C8_UuPsJu0TTboeG4lPJ1EtlgmTO6Q18ohdm_zKgQxmrLRlDi5SpU-ZjSVzLIRa5u6LBsCTR0TutJimllLkII0Ts1UxHVT4475s7UI-5uK5aNVzYOSUMxaGRq9ZaCGPwi2wkROzwm6JUQLDfLI Sep 01 14:15:05.533464 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Id: None Sep 01 14:15:05.533464 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Name: None Sep 01 14:15:05.533464 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Identity-Status: Confirmed Sep 01 14:15:05.533464 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Is-Admin-Project: True Sep 01 14:15:05.533464 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Id: default Sep 01 14:15:05.533464 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Name: Default Sep 01 14:15:05.533464 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Id: 90a84500a899479aabfa3aeb72b4c4ae Sep 01 14:15:05.533464 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Name: tempest-AttachVolumeNegativeTest-836381067 Sep 01 14:15:05.533464 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Role: member,reader Sep 01 14:15:05.533464 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Roles: member,reader Sep 01 14:15:05.536135 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/90a84500a899479aabfa3aeb72b4c4ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/90a84500a899479aabfa3aeb72b4c4ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/90a84500a899479aabfa3aeb72b4c4ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_90a84500a899479aabfa3aeb72b4c4ae"}]}] Sep 01 14:15:05.536135 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant: tempest-AttachVolumeNegativeTest-836381067 Sep 01 14:15:05.536135 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Id: 90a84500a899479aabfa3aeb72b4c4ae Sep 01 14:15:05.536135 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-836381067 Sep 01 14:15:05.536135 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User: tempest-AttachVolumeNegativeTest-836381067-project Sep 01 14:15:05.536135 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Id: default Sep 01 14:15:05.536135 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Name: Default Sep 01 14:15:05.536135 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Id: 7ae66df61a764a42a1b1b15f54d5c34b Sep 01 14:15:05.536135 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Name: tempest-AttachVolumeNegativeTest-836381067-project Sep 01 14:15:05.536135 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: method: > Sep 01 14:15:05.536135 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: exception: Instance 3e82006c-11f2-43d8-b929-e161f9c506d4 could not be found. Sep 01 14:15:05.536135 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: action_args: {'id': '3e82006c-11f2-43d8-b929-e161f9c506d4'} Sep 01 14:15:05.538135 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:15:05.538135 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:05.538135 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:15:05.538135 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:15:05.538135 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:15:05.538135 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:15:05.538135 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:15:05.538135 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:15:05.538135 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:15:05.538135 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:15:05.538135 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e82006c-11f2-43d8-b929-e161f9c506d4 could not be found. Sep 01 14:15:05.538135 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:15:05.538135 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:15:05.538135 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:15:05.538135 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:05.538135 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:15:05.538135 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:15:05.538135 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:15:05.538135 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:15:05.538135 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:15:05.542568 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:15:05.542568 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 14:15:05.542568 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 14:15:05.542568 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 14:15:05.542568 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 14:15:05.542568 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:15:05.542568 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:15:05.542568 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:15:05.542568 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:15:05.542568 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e82006c-11f2-43d8-b929-e161f9c506d4 could not be found. Sep 01 14:15:05.542568 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:15:05.542568 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:15:05.542568 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:15:05.542568 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:05.542568 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:15:05.542568 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:15:05.542568 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:15:05.542568 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:15:05.542568 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e82006c-11f2-43d8-b929-e161f9c506d4 could not be found. Sep 01 14:15:05.542568 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:15:05.546587 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-a9fa5aac-47e6-41c8-b7fb-b9d4a55468b3 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Returning 404 to user: Instance 3e82006c-11f2-43d8-b929-e161f9c506d4 could not be found. {{(pid=121340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:15:05.546587 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-a9fa5aac-47e6-41c8-b7fb-b9d4a55468b3 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4" status: 404 len: 111 microversion: 2.1 time: 0.044013 Sep 01 14:15:05.546587 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 550/1093] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 14:15:05 2022] DELETE /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:15:05.547242 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-6567e4be-b2dc-40e1-bac2-c48816b30626 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:15:05.547242 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-6567e4be-b2dc-40e1-bac2-c48816b30626 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 3e82006c-11f2-43d8-b929-e161f9c506d4] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:15:05.552965 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6567e4be-b2dc-40e1-bac2-c48816b30626 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:05.553454 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6567e4be-b2dc-40e1-bac2-c48816b30626 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:05.553889 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6567e4be-b2dc-40e1-bac2-c48816b30626 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:05.554722 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6567e4be-b2dc-40e1-bac2-c48816b30626 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:05.555237 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6567e4be-b2dc-40e1-bac2-c48816b30626 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:05.555671 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6567e4be-b2dc-40e1-bac2-c48816b30626 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:05.578274 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.wsgi [None req-6567e4be-b2dc-40e1-bac2-c48816b30626 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] HTTP exception thrown: Instance 3e82006c-11f2-43d8-b929-e161f9c506d4 could not be found. Sep 01 14:15:05.580188 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-6567e4be-b2dc-40e1-bac2-c48816b30626 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Request method failure captured: Sep 01 14:15:05.580188 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: request: GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4 HTTP/1.1 Sep 01 14:15:05.580188 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept: application/json Sep 01 14:15:05.580188 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept-Encoding: identity Sep 01 14:15:05.580188 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Connection: close Sep 01 14:15:05.580188 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Length: 0 Sep 01 14:15:05.580188 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Type: application/json Sep 01 14:15:05.580188 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Host: 10.222.0.25 Sep 01 14:15:05.580188 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Openstack-System-Scope: None Sep 01 14:15:05.580188 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: User-Agent: python-urllib3/1.26.12 Sep 01 14:15:05.580188 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Auth-Token: gAAAAABjELyhZj5Hr9I4grX9g-sLmSzxOFwV6C8_UuPsJu0TTboeG4lPJ1EtlgmTO6Q18ohdm_zKgQxmrLRlDi5SpU-ZjSVzLIRa5u6LBsCTR0TutJimllLkII0Ts1UxHVT4475s7UI-5uK5aNVzYOSUMxaGRq9ZaCGPwi2wkROzwm6JUQLDfLI Sep 01 14:15:05.580188 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Id: None Sep 01 14:15:05.580188 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Name: None Sep 01 14:15:05.580188 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Identity-Status: Confirmed Sep 01 14:15:05.580188 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Is-Admin-Project: True Sep 01 14:15:05.580188 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Id: default Sep 01 14:15:05.580188 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Name: Default Sep 01 14:15:05.580188 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Id: 90a84500a899479aabfa3aeb72b4c4ae Sep 01 14:15:05.580188 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Name: tempest-AttachVolumeNegativeTest-836381067 Sep 01 14:15:05.580188 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Role: member,reader Sep 01 14:15:05.580188 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Roles: member,reader Sep 01 14:15:05.583357 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/90a84500a899479aabfa3aeb72b4c4ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/90a84500a899479aabfa3aeb72b4c4ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/90a84500a899479aabfa3aeb72b4c4ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_90a84500a899479aabfa3aeb72b4c4ae"}]}] Sep 01 14:15:05.583357 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant: tempest-AttachVolumeNegativeTest-836381067 Sep 01 14:15:05.583357 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Id: 90a84500a899479aabfa3aeb72b4c4ae Sep 01 14:15:05.583357 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-836381067 Sep 01 14:15:05.583357 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User: tempest-AttachVolumeNegativeTest-836381067-project Sep 01 14:15:05.583357 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Id: default Sep 01 14:15:05.583357 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Name: Default Sep 01 14:15:05.583357 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Id: 7ae66df61a764a42a1b1b15f54d5c34b Sep 01 14:15:05.583357 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Name: tempest-AttachVolumeNegativeTest-836381067-project Sep 01 14:15:05.583357 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: method: > Sep 01 14:15:05.583357 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: exception: Instance 3e82006c-11f2-43d8-b929-e161f9c506d4 could not be found. Sep 01 14:15:05.583357 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: action_args: {'id': '3e82006c-11f2-43d8-b929-e161f9c506d4'} Sep 01 14:15:05.584886 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:15:05.584886 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:05.584886 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:15:05.584886 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:15:05.584886 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:15:05.584886 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:15:05.584886 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:15:05.584886 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:15:05.584886 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:15:05.584886 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:15:05.584886 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e82006c-11f2-43d8-b929-e161f9c506d4 could not be found. Sep 01 14:15:05.584886 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:15:05.584886 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:15:05.584886 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:15:05.584886 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:05.584886 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:15:05.584886 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:15:05.584886 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:15:05.584886 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:15:05.584886 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:15:05.588226 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:15:05.588226 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:15:05.588226 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:15:05.588226 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:15:05.588226 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:15:05.588226 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:15:05.588226 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:15:05.588226 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e82006c-11f2-43d8-b929-e161f9c506d4 could not be found. Sep 01 14:15:05.588226 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:15:05.588226 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:15:05.588226 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:15:05.588226 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:05.588226 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:15:05.588226 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:15:05.588226 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:15:05.588226 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:15:05.588226 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e82006c-11f2-43d8-b929-e161f9c506d4 could not be found. Sep 01 14:15:05.588226 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:15:05.591361 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-6567e4be-b2dc-40e1-bac2-c48816b30626 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Returning 404 to user: Instance 3e82006c-11f2-43d8-b929-e161f9c506d4 could not be found. {{(pid=121339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:15:05.591361 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-6567e4be-b2dc-40e1-bac2-c48816b30626 tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4" status: 404 len: 111 microversion: 2.1 time: 0.042468 Sep 01 14:15:05.591361 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 544/1094] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:15:05 2022] GET /compute/v2.1/servers/3e82006c-11f2-43d8-b929-e161f9c506d4 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 14:15:05.938542 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-66d7b9eb-8315-4ae8-9e28-4bc99c9a4674 tempest-VolumesNegativeTest-243895022 tempest-VolumesNegativeTest-243895022-project] Action: 'create', calling method: .version_select at 0x7f98679b0820>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1017223938", "metadata": {"Type": "work"}}} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:15:05.953089 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-66d7b9eb-8315-4ae8-9e28-4bc99c9a4674 tempest-VolumesNegativeTest-243895022 tempest-VolumesNegativeTest-243895022-project] Request method failure captured: Sep 01 14:15:05.953089 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 14:15:05.953089 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept: application/json Sep 01 14:15:05.953089 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept-Encoding: identity Sep 01 14:15:05.953089 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Connection: close Sep 01 14:15:05.953089 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Length: 122 Sep 01 14:15:05.953089 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Type: application/json Sep 01 14:15:05.953089 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Host: 10.222.0.25 Sep 01 14:15:05.953089 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Openstack-System-Scope: None Sep 01 14:15:05.953089 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: User-Agent: python-urllib3/1.26.12 Sep 01 14:15:05.953089 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Auth-Token: gAAAAABjEL5p4HVL2i-D6T1HFuE1MDmlFlxAfkfQnYre0E2fQKjEhLHnQvYliCFCT2mTTVlTRaql5dygSPvpRuHUvzEO-jIMldCz82I3V75IW5RYG2PsGSBwoKsgEVLWOAxoQllYyUfOHrcIyZ_faERTCdEzryIs74WBdFL4zrSEguJ5aMy-HZY Sep 01 14:15:05.953089 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Id: None Sep 01 14:15:05.953089 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Name: None Sep 01 14:15:05.953089 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Identity-Status: Confirmed Sep 01 14:15:05.953089 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Is-Admin-Project: True Sep 01 14:15:05.953089 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Id: default Sep 01 14:15:05.953089 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Name: Default Sep 01 14:15:05.953089 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Id: a7dd58dd75ac4de986e5790ee1fb9dcc Sep 01 14:15:05.953089 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Name: tempest-VolumesNegativeTest-243895022 Sep 01 14:15:05.953089 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Role: member,reader Sep 01 14:15:05.953089 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Roles: member,reader Sep 01 14:15:05.956031 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7dd58dd75ac4de986e5790ee1fb9dcc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a7dd58dd75ac4de986e5790ee1fb9dcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7dd58dd75ac4de986e5790ee1fb9dcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a7dd58dd75ac4de986e5790ee1fb9dcc"}]}] Sep 01 14:15:05.956031 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant: tempest-VolumesNegativeTest-243895022 Sep 01 14:15:05.956031 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Id: a7dd58dd75ac4de986e5790ee1fb9dcc Sep 01 14:15:05.956031 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Name: tempest-VolumesNegativeTest-243895022 Sep 01 14:15:05.956031 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User: tempest-VolumesNegativeTest-243895022-project Sep 01 14:15:05.956031 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Id: default Sep 01 14:15:05.956031 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Name: Default Sep 01 14:15:05.956031 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Id: 299992c07bcf40af9d44d0a26aa9a429 Sep 01 14:15:05.956031 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Name: tempest-VolumesNegativeTest-243895022-project Sep 01 14:15:05.956031 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Sep 01 14:15:05.956031 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1017223938", "metadata": {"Type": "work"}}} Sep 01 14:15:05.956031 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: method: Sep 01 14:15:05.956031 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 14:15:05.957548 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1017223938', 'metadata': {'Type': 'work'}}}} Sep 01 14:15:05.957548 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:15:05.957548 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:05.957548 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 14:15:05.957548 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 14:15:05.957548 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 14:15:05.957548 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise error Sep 01 14:15:05.957548 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 01 14:15:05.957548 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:15:05.957548 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 01 14:15:05.957548 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 14:15:05.957548 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:15:05.957548 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 14:15:05.957548 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi '#$%' Sep 01 14:15:05.957548 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:15:05.957548 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:15:05.957548 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:15:05.957548 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:05.957548 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:15:05.957548 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:15:05.957548 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:15:05.957548 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:15:05.960608 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 14:15:05.960608 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 14:15:05.960608 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:15:05.960608 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:15:05.960608 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 14:15:05.960608 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 14:15:05.960608 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 14:15:05.960608 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 14:15:05.960608 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 14:15:05.960608 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 14:15:05.960608 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 14:15:05.960608 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:15:05.960608 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:15:05.960608 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:15:05.960608 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:05.960608 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:15:05.960608 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:15:05.960608 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 14:15:05.960608 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 14:15:05.963973 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 14:15:05.963973 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:15:05.963973 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-66d7b9eb-8315-4ae8-9e28-4bc99c9a4674 tempest-VolumesNegativeTest-243895022 tempest-VolumesNegativeTest-243895022-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:15:05.963973 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-66d7b9eb-8315-4ae8-9e28-4bc99c9a4674 tempest-VolumesNegativeTest-243895022 tempest-VolumesNegativeTest-243895022-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.236229 Sep 01 14:15:05.963973 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 551/1095] 10.222.0.25 () {60 vars in 1156 bytes} [Thu Sep 1 14:15:05 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 238 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 01 14:15:05.971912 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-ecf5a62f-0700-4078-945b-7d701a1efd1c tempest-VolumesNegativeTest-243895022 tempest-VolumesNegativeTest-243895022-project] Action: 'create', calling method: .version_select at 0x7f9867a61dc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1182174012", "metadata": {"Type": "work"}}} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:15:05.979498 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-ecf5a62f-0700-4078-945b-7d701a1efd1c tempest-VolumesNegativeTest-243895022 tempest-VolumesNegativeTest-243895022-project] Request method failure captured: Sep 01 14:15:05.979498 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 14:15:05.979498 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept: application/json Sep 01 14:15:05.979498 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept-Encoding: identity Sep 01 14:15:05.979498 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Connection: close Sep 01 14:15:05.979498 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Length: 120 Sep 01 14:15:05.979498 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Type: application/json Sep 01 14:15:05.979498 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Host: 10.222.0.25 Sep 01 14:15:05.979498 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Openstack-System-Scope: None Sep 01 14:15:05.979498 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: User-Agent: python-urllib3/1.26.12 Sep 01 14:15:05.979498 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Auth-Token: gAAAAABjEL5p4HVL2i-D6T1HFuE1MDmlFlxAfkfQnYre0E2fQKjEhLHnQvYliCFCT2mTTVlTRaql5dygSPvpRuHUvzEO-jIMldCz82I3V75IW5RYG2PsGSBwoKsgEVLWOAxoQllYyUfOHrcIyZ_faERTCdEzryIs74WBdFL4zrSEguJ5aMy-HZY Sep 01 14:15:05.979498 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Id: None Sep 01 14:15:05.979498 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Name: None Sep 01 14:15:05.979498 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Identity-Status: Confirmed Sep 01 14:15:05.979498 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Is-Admin-Project: True Sep 01 14:15:05.979498 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Id: default Sep 01 14:15:05.979498 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Name: Default Sep 01 14:15:05.979498 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Id: a7dd58dd75ac4de986e5790ee1fb9dcc Sep 01 14:15:05.979498 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Name: tempest-VolumesNegativeTest-243895022 Sep 01 14:15:05.979498 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Role: member,reader Sep 01 14:15:05.979498 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Roles: member,reader Sep 01 14:15:05.985250 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7dd58dd75ac4de986e5790ee1fb9dcc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a7dd58dd75ac4de986e5790ee1fb9dcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7dd58dd75ac4de986e5790ee1fb9dcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a7dd58dd75ac4de986e5790ee1fb9dcc"}]}] Sep 01 14:15:05.985250 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant: tempest-VolumesNegativeTest-243895022 Sep 01 14:15:05.985250 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Id: a7dd58dd75ac4de986e5790ee1fb9dcc Sep 01 14:15:05.985250 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Name: tempest-VolumesNegativeTest-243895022 Sep 01 14:15:05.985250 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User: tempest-VolumesNegativeTest-243895022-project Sep 01 14:15:05.985250 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Id: default Sep 01 14:15:05.985250 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Name: Default Sep 01 14:15:05.985250 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Id: 299992c07bcf40af9d44d0a26aa9a429 Sep 01 14:15:05.985250 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Name: tempest-VolumesNegativeTest-243895022-project Sep 01 14:15:05.985250 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Sep 01 14:15:05.985250 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1182174012", "metadata": {"Type": "work"}}} Sep 01 14:15:05.985250 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: method: Sep 01 14:15:05.985250 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 14:15:05.988025 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1182174012', 'metadata': {'Type': 'work'}}}} Sep 01 14:15:05.988025 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:15:05.988025 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:05.988025 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 14:15:05.988025 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 14:15:05.988025 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 14:15:05.988025 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise error Sep 01 14:15:05.988025 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 01 14:15:05.988025 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:15:05.988025 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 01 14:15:05.988025 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 14:15:05.988025 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:15:05.988025 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 14:15:05.988025 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi '0' Sep 01 14:15:05.988025 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:15:05.988025 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:15:05.988025 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:15:05.988025 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:05.988025 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:15:05.988025 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:15:05.988025 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:15:05.988025 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:15:05.991661 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 14:15:05.991661 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 14:15:05.991661 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:15:05.991661 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:15:05.991661 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 14:15:05.991661 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 14:15:05.991661 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 14:15:05.991661 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 14:15:05.991661 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 14:15:05.991661 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 14:15:05.991661 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 14:15:05.991661 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:15:05.991661 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:15:05.991661 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:15:05.991661 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:05.991661 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:15:05.991661 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:15:05.991661 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 14:15:05.991661 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 14:15:05.995214 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 14:15:05.995214 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:15:05.995214 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-ecf5a62f-0700-4078-945b-7d701a1efd1c tempest-VolumesNegativeTest-243895022 tempest-VolumesNegativeTest-243895022-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:15:05.995214 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-ecf5a62f-0700-4078-945b-7d701a1efd1c tempest-VolumesNegativeTest-243895022 tempest-VolumesNegativeTest-243895022-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.016721 Sep 01 14:15:05.995214 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 545/1096] 10.222.0.25 () {60 vars in 1156 bytes} [Thu Sep 1 14:15:05 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 14:15:06.005460 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-2fcd74ed-f470-4439-a4fa-a005a5e0a180 tempest-VolumesNegativeTest-243895022 tempest-VolumesNegativeTest-243895022-project] Action: 'create', calling method: .version_select at 0x7f98678d50d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1784610464", "metadata": {"Type": "work"}}} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:15:06.011885 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-2fcd74ed-f470-4439-a4fa-a005a5e0a180 tempest-VolumesNegativeTest-243895022 tempest-VolumesNegativeTest-243895022-project] Request method failure captured: Sep 01 14:15:06.011885 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 14:15:06.011885 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept: application/json Sep 01 14:15:06.011885 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept-Encoding: identity Sep 01 14:15:06.011885 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Connection: close Sep 01 14:15:06.011885 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Length: 119 Sep 01 14:15:06.011885 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Type: application/json Sep 01 14:15:06.011885 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Host: 10.222.0.25 Sep 01 14:15:06.011885 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Openstack-System-Scope: None Sep 01 14:15:06.011885 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: User-Agent: python-urllib3/1.26.12 Sep 01 14:15:06.011885 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Auth-Token: gAAAAABjEL5p4HVL2i-D6T1HFuE1MDmlFlxAfkfQnYre0E2fQKjEhLHnQvYliCFCT2mTTVlTRaql5dygSPvpRuHUvzEO-jIMldCz82I3V75IW5RYG2PsGSBwoKsgEVLWOAxoQllYyUfOHrcIyZ_faERTCdEzryIs74WBdFL4zrSEguJ5aMy-HZY Sep 01 14:15:06.011885 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Id: None Sep 01 14:15:06.011885 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Name: None Sep 01 14:15:06.011885 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Identity-Status: Confirmed Sep 01 14:15:06.011885 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Is-Admin-Project: True Sep 01 14:15:06.011885 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Id: default Sep 01 14:15:06.011885 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Name: Default Sep 01 14:15:06.011885 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Id: a7dd58dd75ac4de986e5790ee1fb9dcc Sep 01 14:15:06.011885 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Name: tempest-VolumesNegativeTest-243895022 Sep 01 14:15:06.011885 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Role: member,reader Sep 01 14:15:06.011885 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Roles: member,reader Sep 01 14:15:06.014160 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7dd58dd75ac4de986e5790ee1fb9dcc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a7dd58dd75ac4de986e5790ee1fb9dcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7dd58dd75ac4de986e5790ee1fb9dcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a7dd58dd75ac4de986e5790ee1fb9dcc"}]}] Sep 01 14:15:06.014160 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant: tempest-VolumesNegativeTest-243895022 Sep 01 14:15:06.014160 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Id: a7dd58dd75ac4de986e5790ee1fb9dcc Sep 01 14:15:06.014160 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Name: tempest-VolumesNegativeTest-243895022 Sep 01 14:15:06.014160 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User: tempest-VolumesNegativeTest-243895022-project Sep 01 14:15:06.014160 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Id: default Sep 01 14:15:06.014160 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Name: Default Sep 01 14:15:06.014160 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Id: 299992c07bcf40af9d44d0a26aa9a429 Sep 01 14:15:06.014160 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Name: tempest-VolumesNegativeTest-243895022-project Sep 01 14:15:06.014160 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Sep 01 14:15:06.014160 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1784610464", "metadata": {"Type": "work"}}} Sep 01 14:15:06.014160 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: method: Sep 01 14:15:06.014160 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 14:15:06.015926 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1784610464', 'metadata': {'Type': 'work'}}}} Sep 01 14:15:06.015926 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:15:06.015926 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:06.015926 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 14:15:06.015926 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 14:15:06.015926 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 14:15:06.015926 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise error Sep 01 14:15:06.015926 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 01 14:15:06.015926 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:15:06.015926 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 01 14:15:06.015926 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 14:15:06.015926 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:15:06.015926 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 14:15:06.015926 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi '' Sep 01 14:15:06.015926 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:15:06.015926 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:15:06.015926 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:15:06.015926 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:06.015926 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:15:06.015926 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:15:06.015926 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:15:06.015926 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:15:06.020443 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 14:15:06.020443 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 14:15:06.020443 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:15:06.020443 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:15:06.020443 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 14:15:06.020443 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 14:15:06.020443 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 14:15:06.020443 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 14:15:06.020443 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 14:15:06.020443 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 14:15:06.020443 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 14:15:06.020443 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:15:06.020443 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:15:06.020443 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:15:06.020443 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:06.020443 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:15:06.020443 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:15:06.020443 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 14:15:06.020443 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 14:15:06.023843 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 14:15:06.023843 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:15:06.023843 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-2fcd74ed-f470-4439-a4fa-a005a5e0a180 tempest-VolumesNegativeTest-243895022 tempest-VolumesNegativeTest-243895022-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:15:06.023843 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-2fcd74ed-f470-4439-a4fa-a005a5e0a180 tempest-VolumesNegativeTest-243895022 tempest-VolumesNegativeTest-243895022-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.012968 Sep 01 14:15:06.023843 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 552/1097] 10.222.0.25 () {60 vars in 1156 bytes} [Thu Sep 1 14:15:05 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 14:15:06.036081 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-2ae16055-f2bb-4f83-ad03-4eb14077d0bc tempest-VolumesNegativeTest-243895022 tempest-VolumesNegativeTest-243895022-project] Calling method '.version_select at 0x7f98679d8430>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:15:06.090555 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.wsgi [None req-2ae16055-f2bb-4f83-ad03-4eb14077d0bc tempest-VolumesNegativeTest-243895022 tempest-VolumesNegativeTest-243895022-project] HTTP exception thrown: Volume tempest-invalid-1223714782 could not be found. Sep 01 14:15:06.092629 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-2ae16055-f2bb-4f83-ad03-4eb14077d0bc tempest-VolumesNegativeTest-243895022 tempest-VolumesNegativeTest-243895022-project] Request method failure captured: Sep 01 14:15:06.092629 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1223714782 HTTP/1.1 Sep 01 14:15:06.092629 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept: application/json Sep 01 14:15:06.092629 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept-Encoding: identity Sep 01 14:15:06.092629 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Connection: close Sep 01 14:15:06.092629 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Length: 0 Sep 01 14:15:06.092629 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Type: application/json Sep 01 14:15:06.092629 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Host: 10.222.0.25 Sep 01 14:15:06.092629 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Openstack-System-Scope: None Sep 01 14:15:06.092629 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: User-Agent: python-urllib3/1.26.12 Sep 01 14:15:06.092629 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Auth-Token: gAAAAABjEL5p4HVL2i-D6T1HFuE1MDmlFlxAfkfQnYre0E2fQKjEhLHnQvYliCFCT2mTTVlTRaql5dygSPvpRuHUvzEO-jIMldCz82I3V75IW5RYG2PsGSBwoKsgEVLWOAxoQllYyUfOHrcIyZ_faERTCdEzryIs74WBdFL4zrSEguJ5aMy-HZY Sep 01 14:15:06.092629 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Id: None Sep 01 14:15:06.092629 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Name: None Sep 01 14:15:06.092629 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Identity-Status: Confirmed Sep 01 14:15:06.092629 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Is-Admin-Project: True Sep 01 14:15:06.092629 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Id: default Sep 01 14:15:06.092629 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Name: Default Sep 01 14:15:06.092629 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Id: a7dd58dd75ac4de986e5790ee1fb9dcc Sep 01 14:15:06.092629 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Name: tempest-VolumesNegativeTest-243895022 Sep 01 14:15:06.092629 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Role: member,reader Sep 01 14:15:06.092629 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Roles: member,reader Sep 01 14:15:06.095249 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7dd58dd75ac4de986e5790ee1fb9dcc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a7dd58dd75ac4de986e5790ee1fb9dcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7dd58dd75ac4de986e5790ee1fb9dcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a7dd58dd75ac4de986e5790ee1fb9dcc"}]}] Sep 01 14:15:06.095249 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant: tempest-VolumesNegativeTest-243895022 Sep 01 14:15:06.095249 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Id: a7dd58dd75ac4de986e5790ee1fb9dcc Sep 01 14:15:06.095249 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Name: tempest-VolumesNegativeTest-243895022 Sep 01 14:15:06.095249 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User: tempest-VolumesNegativeTest-243895022-project Sep 01 14:15:06.095249 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Id: default Sep 01 14:15:06.095249 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Name: Default Sep 01 14:15:06.095249 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Id: 299992c07bcf40af9d44d0a26aa9a429 Sep 01 14:15:06.095249 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Name: tempest-VolumesNegativeTest-243895022-project Sep 01 14:15:06.095249 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: method: Sep 01 14:15:06.095249 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: exception: Volume tempest-invalid-1223714782 could not be found. Sep 01 14:15:06.095249 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: action_args: {'id': 'tempest-invalid-1223714782'} Sep 01 14:15:06.095249 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:15:06.097082 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:06.097082 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 14:15:06.097082 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 14:15:06.097082 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 14:15:06.097082 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 14:15:06.097082 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 14:15:06.097082 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 14:15:06.097082 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 14:15:06.097082 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 14:15:06.097082 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 14:15:06.097082 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 14:15:06.097082 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:15:06.097082 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:15:06.097082 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:15:06.097082 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:15:06.097082 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1223714782 could not be found. (HTTP 404) (Request-ID: req-296eb41f-52f4-4fe3-9622-b27a4319af37) Sep 01 14:15:06.097082 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:15:06.097082 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:15:06.097082 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:15:06.100145 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:06.100145 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 14:15:06.100145 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 14:15:06.100145 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 14:15:06.100145 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 14:15:06.100145 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 14:15:06.100145 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 14:15:06.100145 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 14:15:06.100145 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 14:15:06.100145 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 14:15:06.100145 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 14:15:06.100145 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 14:15:06.100145 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 14:15:06.100145 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 14:15:06.100145 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 14:15:06.100145 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 14:15:06.100145 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 14:15:06.100145 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 14:15:06.100145 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 14:15:06.103161 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:15:06.103161 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:15:06.103161 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:15:06.103161 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:15:06.103161 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1223714782 could not be found. Sep 01 14:15:06.103161 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:15:06.103161 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:15:06.103161 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:15:06.103161 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:06.103161 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:15:06.103161 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:15:06.103161 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:15:06.103161 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:15:06.103161 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 14:15:06.103161 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 14:15:06.103161 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:15:06.103161 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:15:06.103161 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 14:15:06.103161 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:15:06.103161 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1223714782 could not be found. Sep 01 14:15:06.105616 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:15:06.105616 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:15:06.105616 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:15:06.105616 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:06.105616 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:15:06.105616 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:15:06.105616 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:15:06.105616 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:15:06.105616 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1223714782 could not be found. Sep 01 14:15:06.105616 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:15:06.105616 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-2ae16055-f2bb-4f83-ad03-4eb14077d0bc tempest-VolumesNegativeTest-243895022 tempest-VolumesNegativeTest-243895022-project] Returning 404 to user: Volume tempest-invalid-1223714782 could not be found. {{(pid=121339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:15:06.105616 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-2ae16055-f2bb-4f83-ad03-4eb14077d0bc tempest-VolumesNegativeTest-243895022 tempest-VolumesNegativeTest-243895022-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1223714782" status: 404 len: 99 microversion: 2.1 time: 0.069940 Sep 01 14:15:06.105616 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 546/1098] 10.222.0.25 () {58 vars in 1218 bytes} [Thu Sep 1 14:15:06 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1223714782 => generated 99 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 14:15:06.111961 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-8239fe2f-55fa-474e-95cb-71df3bd4ef93 tempest-VolumesNegativeTest-243895022 tempest-VolumesNegativeTest-243895022-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007590 Sep 01 14:15:06.112950 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 553/1099] 10.222.0.25 () {58 vars in 1140 bytes} [Thu Sep 1 14:15:06 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 01 14:15:06.123825 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-4eaf77e3-d031-427f-a9d2-17f7f8ace683 tempest-VolumesNegativeTest-243895022 tempest-VolumesNegativeTest-243895022-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004000 Sep 01 14:15:06.124355 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 547/1100] 10.222.0.25 () {58 vars in 1137 bytes} [Thu Sep 1 14:15:06 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 01 14:15:06.136022 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-30e31d5e-d10c-4fe0-a413-21e068633bed tempest-VolumesNegativeTest-243895022 tempest-VolumesNegativeTest-243895022-project] Calling method '.version_select at 0x7f98679b08b0>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:15:06.169308 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.wsgi [None req-30e31d5e-d10c-4fe0-a413-21e068633bed tempest-VolumesNegativeTest-243895022 tempest-VolumesNegativeTest-243895022-project] HTTP exception thrown: Volume 528180da-3dfb-4f11-a752-e197af55f802 could not be found. Sep 01 14:15:06.171877 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-30e31d5e-d10c-4fe0-a413-21e068633bed tempest-VolumesNegativeTest-243895022 tempest-VolumesNegativeTest-243895022-project] Request method failure captured: Sep 01 14:15:06.171877 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: request: DELETE /compute/v2.1/os-volumes/528180da-3dfb-4f11-a752-e197af55f802 HTTP/1.1 Sep 01 14:15:06.171877 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept: application/json Sep 01 14:15:06.171877 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept-Encoding: identity Sep 01 14:15:06.171877 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Connection: close Sep 01 14:15:06.171877 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Length: 0 Sep 01 14:15:06.171877 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Type: application/json Sep 01 14:15:06.171877 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Host: 10.222.0.25 Sep 01 14:15:06.171877 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Openstack-System-Scope: None Sep 01 14:15:06.171877 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: User-Agent: python-urllib3/1.26.12 Sep 01 14:15:06.171877 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Auth-Token: gAAAAABjEL5p4HVL2i-D6T1HFuE1MDmlFlxAfkfQnYre0E2fQKjEhLHnQvYliCFCT2mTTVlTRaql5dygSPvpRuHUvzEO-jIMldCz82I3V75IW5RYG2PsGSBwoKsgEVLWOAxoQllYyUfOHrcIyZ_faERTCdEzryIs74WBdFL4zrSEguJ5aMy-HZY Sep 01 14:15:06.171877 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Id: None Sep 01 14:15:06.171877 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Name: None Sep 01 14:15:06.171877 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Identity-Status: Confirmed Sep 01 14:15:06.171877 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Is-Admin-Project: True Sep 01 14:15:06.171877 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Id: default Sep 01 14:15:06.171877 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Name: Default Sep 01 14:15:06.171877 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Id: a7dd58dd75ac4de986e5790ee1fb9dcc Sep 01 14:15:06.171877 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Name: tempest-VolumesNegativeTest-243895022 Sep 01 14:15:06.171877 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Role: member,reader Sep 01 14:15:06.171877 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Roles: member,reader Sep 01 14:15:06.174295 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7dd58dd75ac4de986e5790ee1fb9dcc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a7dd58dd75ac4de986e5790ee1fb9dcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7dd58dd75ac4de986e5790ee1fb9dcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a7dd58dd75ac4de986e5790ee1fb9dcc"}]}] Sep 01 14:15:06.174295 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant: tempest-VolumesNegativeTest-243895022 Sep 01 14:15:06.174295 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Id: a7dd58dd75ac4de986e5790ee1fb9dcc Sep 01 14:15:06.174295 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Name: tempest-VolumesNegativeTest-243895022 Sep 01 14:15:06.174295 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User: tempest-VolumesNegativeTest-243895022-project Sep 01 14:15:06.174295 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Id: default Sep 01 14:15:06.174295 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Name: Default Sep 01 14:15:06.174295 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Id: 299992c07bcf40af9d44d0a26aa9a429 Sep 01 14:15:06.174295 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Name: tempest-VolumesNegativeTest-243895022-project Sep 01 14:15:06.174295 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: method: Sep 01 14:15:06.174295 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: exception: Volume 528180da-3dfb-4f11-a752-e197af55f802 could not be found. Sep 01 14:15:06.174295 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: action_args: {'id': '528180da-3dfb-4f11-a752-e197af55f802'} Sep 01 14:15:06.174295 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:15:06.175498 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:06.175498 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 14:15:06.175498 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 14:15:06.175498 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 14:15:06.175498 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 14:15:06.175498 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 14:15:06.175498 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 14:15:06.175498 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 14:15:06.175498 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 14:15:06.175498 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 14:15:06.175498 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 14:15:06.175498 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:15:06.175498 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:15:06.175498 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:15:06.175498 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:15:06.175498 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 528180da-3dfb-4f11-a752-e197af55f802 could not be found. (HTTP 404) (Request-ID: req-027009c7-ebb4-4e15-a961-080a80f2ba26) Sep 01 14:15:06.175498 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:15:06.175498 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:15:06.175498 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:15:06.176919 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:06.176919 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 14:15:06.176919 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 14:15:06.176919 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 14:15:06.176919 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 14:15:06.176919 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 14:15:06.176919 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 14:15:06.176919 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 14:15:06.176919 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 14:15:06.176919 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 14:15:06.176919 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 14:15:06.176919 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 14:15:06.176919 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 14:15:06.176919 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 14:15:06.176919 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 14:15:06.176919 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 14:15:06.176919 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 14:15:06.176919 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 14:15:06.176919 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 14:15:06.178739 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:15:06.178739 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:15:06.178739 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:15:06.178739 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:15:06.178739 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 528180da-3dfb-4f11-a752-e197af55f802 could not be found. Sep 01 14:15:06.178739 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:15:06.178739 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:15:06.178739 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:15:06.178739 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:06.178739 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:15:06.178739 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:15:06.178739 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:15:06.178739 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:15:06.178739 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 14:15:06.178739 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 14:15:06.178739 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:15:06.178739 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:15:06.178739 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 14:15:06.178739 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:15:06.180344 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 528180da-3dfb-4f11-a752-e197af55f802 could not be found. Sep 01 14:15:06.180344 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:15:06.180344 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:15:06.180344 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:15:06.180344 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:06.180344 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:15:06.180344 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:15:06.180344 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:15:06.180344 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:15:06.180344 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 528180da-3dfb-4f11-a752-e197af55f802 could not be found. Sep 01 14:15:06.180344 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:15:06.180344 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-30e31d5e-d10c-4fe0-a413-21e068633bed tempest-VolumesNegativeTest-243895022 tempest-VolumesNegativeTest-243895022-project] Returning 404 to user: Volume 528180da-3dfb-4f11-a752-e197af55f802 could not be found. {{(pid=121340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:15:06.180344 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-30e31d5e-d10c-4fe0-a413-21e068633bed tempest-VolumesNegativeTest-243895022 tempest-VolumesNegativeTest-243895022-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/528180da-3dfb-4f11-a752-e197af55f802" status: 404 len: 109 microversion: 2.1 time: 0.042822 Sep 01 14:15:06.180344 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 554/1101] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Sep 1 14:15:06 2022] DELETE /compute/v2.1/os-volumes/528180da-3dfb-4f11-a752-e197af55f802 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:15:06.186585 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-9c5ac855-1410-4576-ab84-ad9c683f8f88 tempest-VolumesNegativeTest-243895022 tempest-VolumesNegativeTest-243895022-project] Calling method '.version_select at 0x7f9867a618b0>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:15:06.219254 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.wsgi [None req-9c5ac855-1410-4576-ab84-ad9c683f8f88 tempest-VolumesNegativeTest-243895022 tempest-VolumesNegativeTest-243895022-project] HTTP exception thrown: Volume 54b17de0-f6ec-4677-885d-c0a5856dd744 could not be found. Sep 01 14:15:06.221400 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-9c5ac855-1410-4576-ab84-ad9c683f8f88 tempest-VolumesNegativeTest-243895022 tempest-VolumesNegativeTest-243895022-project] Request method failure captured: Sep 01 14:15:06.221400 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: request: GET /compute/v2.1/os-volumes/54b17de0-f6ec-4677-885d-c0a5856dd744 HTTP/1.1 Sep 01 14:15:06.221400 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept: application/json Sep 01 14:15:06.221400 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept-Encoding: identity Sep 01 14:15:06.221400 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Connection: close Sep 01 14:15:06.221400 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Length: 0 Sep 01 14:15:06.221400 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Type: application/json Sep 01 14:15:06.221400 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Host: 10.222.0.25 Sep 01 14:15:06.221400 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Openstack-System-Scope: None Sep 01 14:15:06.221400 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: User-Agent: python-urllib3/1.26.12 Sep 01 14:15:06.221400 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Auth-Token: gAAAAABjEL5p4HVL2i-D6T1HFuE1MDmlFlxAfkfQnYre0E2fQKjEhLHnQvYliCFCT2mTTVlTRaql5dygSPvpRuHUvzEO-jIMldCz82I3V75IW5RYG2PsGSBwoKsgEVLWOAxoQllYyUfOHrcIyZ_faERTCdEzryIs74WBdFL4zrSEguJ5aMy-HZY Sep 01 14:15:06.221400 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Id: None Sep 01 14:15:06.221400 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Name: None Sep 01 14:15:06.221400 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Identity-Status: Confirmed Sep 01 14:15:06.221400 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Is-Admin-Project: True Sep 01 14:15:06.221400 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Id: default Sep 01 14:15:06.221400 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Name: Default Sep 01 14:15:06.221400 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Id: a7dd58dd75ac4de986e5790ee1fb9dcc Sep 01 14:15:06.221400 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Name: tempest-VolumesNegativeTest-243895022 Sep 01 14:15:06.221400 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Role: member,reader Sep 01 14:15:06.221400 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Roles: member,reader Sep 01 14:15:06.230316 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7dd58dd75ac4de986e5790ee1fb9dcc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a7dd58dd75ac4de986e5790ee1fb9dcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a7dd58dd75ac4de986e5790ee1fb9dcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a7dd58dd75ac4de986e5790ee1fb9dcc"}]}] Sep 01 14:15:06.230316 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant: tempest-VolumesNegativeTest-243895022 Sep 01 14:15:06.230316 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Id: a7dd58dd75ac4de986e5790ee1fb9dcc Sep 01 14:15:06.230316 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Name: tempest-VolumesNegativeTest-243895022 Sep 01 14:15:06.230316 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User: tempest-VolumesNegativeTest-243895022-project Sep 01 14:15:06.230316 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Id: default Sep 01 14:15:06.230316 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Name: Default Sep 01 14:15:06.230316 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Id: 299992c07bcf40af9d44d0a26aa9a429 Sep 01 14:15:06.230316 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Name: tempest-VolumesNegativeTest-243895022-project Sep 01 14:15:06.230316 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: method: Sep 01 14:15:06.230316 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: exception: Volume 54b17de0-f6ec-4677-885d-c0a5856dd744 could not be found. Sep 01 14:15:06.230316 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: action_args: {'id': '54b17de0-f6ec-4677-885d-c0a5856dd744'} Sep 01 14:15:06.230316 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:15:06.232371 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:06.232371 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 14:15:06.232371 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 14:15:06.232371 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 14:15:06.232371 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 14:15:06.232371 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 14:15:06.232371 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 14:15:06.232371 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 14:15:06.232371 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 14:15:06.232371 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 14:15:06.232371 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 14:15:06.232371 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:15:06.232371 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:15:06.232371 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:15:06.232371 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:15:06.232371 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 54b17de0-f6ec-4677-885d-c0a5856dd744 could not be found. (HTTP 404) (Request-ID: req-d4b8c659-b524-4a01-ae18-72853f81d580) Sep 01 14:15:06.232371 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:15:06.232371 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:15:06.232371 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:15:06.235070 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:06.235070 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 14:15:06.235070 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 14:15:06.235070 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 14:15:06.235070 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 14:15:06.235070 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 14:15:06.235070 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 14:15:06.235070 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 14:15:06.235070 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 14:15:06.235070 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 14:15:06.235070 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 14:15:06.235070 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 14:15:06.235070 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 14:15:06.235070 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 14:15:06.235070 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 14:15:06.235070 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 14:15:06.235070 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 14:15:06.235070 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 14:15:06.235070 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 14:15:06.237644 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:15:06.237644 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:15:06.237644 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:15:06.237644 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:15:06.237644 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 54b17de0-f6ec-4677-885d-c0a5856dd744 could not be found. Sep 01 14:15:06.237644 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:15:06.237644 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:15:06.237644 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:15:06.237644 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:06.237644 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:15:06.237644 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:15:06.237644 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:15:06.237644 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:15:06.237644 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 14:15:06.237644 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 14:15:06.237644 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:15:06.237644 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:15:06.237644 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 14:15:06.237644 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:15:06.239882 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 54b17de0-f6ec-4677-885d-c0a5856dd744 could not be found. Sep 01 14:15:06.239882 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:15:06.239882 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:15:06.239882 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:15:06.239882 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:06.239882 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:15:06.239882 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:15:06.239882 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:15:06.239882 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:15:06.239882 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 54b17de0-f6ec-4677-885d-c0a5856dd744 could not be found. Sep 01 14:15:06.239882 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:15:06.239882 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-9c5ac855-1410-4576-ab84-ad9c683f8f88 tempest-VolumesNegativeTest-243895022 tempest-VolumesNegativeTest-243895022-project] Returning 404 to user: Volume 54b17de0-f6ec-4677-885d-c0a5856dd744 could not be found. {{(pid=121339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:15:06.239882 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-9c5ac855-1410-4576-ab84-ad9c683f8f88 tempest-VolumesNegativeTest-243895022 tempest-VolumesNegativeTest-243895022-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/54b17de0-f6ec-4677-885d-c0a5856dd744" status: 404 len: 109 microversion: 2.1 time: 0.042008 Sep 01 14:15:06.239882 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 548/1102] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 1 14:15:06 2022] GET /compute/v2.1/os-volumes/54b17de0-f6ec-4677-885d-c0a5856dd744 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:15:09.186237 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-fdfde4f8-b4e2-45c6-8ac9-fa76ff5bf73e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:15:09.189692 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-fdfde4f8-b4e2-45c6-8ac9-fa76ff5bf73e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 91814986-adf4-46cb-8edf-820106d37ecb] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:15:09.209938 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-fdfde4f8-b4e2-45c6-8ac9-fa76ff5bf73e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:09.210813 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-fdfde4f8-b4e2-45c6-8ac9-fa76ff5bf73e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:09.211551 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-fdfde4f8-b4e2-45c6-8ac9-fa76ff5bf73e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:09.212810 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-fdfde4f8-b4e2-45c6-8ac9-fa76ff5bf73e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:09.214169 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-fdfde4f8-b4e2-45c6-8ac9-fa76ff5bf73e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:09.215330 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-fdfde4f8-b4e2-45c6-8ac9-fa76ff5bf73e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:09.264021 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.wsgi [None req-fdfde4f8-b4e2-45c6-8ac9-fa76ff5bf73e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] HTTP exception thrown: Instance 91814986-adf4-46cb-8edf-820106d37ecb could not be found. Sep 01 14:15:09.268983 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-fdfde4f8-b4e2-45c6-8ac9-fa76ff5bf73e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Request method failure captured: Sep 01 14:15:09.268983 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: request: DELETE /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb HTTP/1.1 Sep 01 14:15:09.268983 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept: application/json Sep 01 14:15:09.268983 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept-Encoding: identity Sep 01 14:15:09.268983 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Connection: close Sep 01 14:15:09.268983 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Length: 0 Sep 01 14:15:09.268983 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Type: application/json Sep 01 14:15:09.268983 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Host: 10.222.0.25 Sep 01 14:15:09.268983 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Openstack-System-Scope: None Sep 01 14:15:09.268983 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: User-Agent: python-urllib3/1.26.12 Sep 01 14:15:09.268983 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Auth-Token: gAAAAABjELyhZj5Hr9I4grX9g-sLmSzxOFwV6C8_UuPsJu0TTboeG4lPJ1EtlgmTO6Q18ohdm_zKgQxmrLRlDi5SpU-ZjSVzLIRa5u6LBsCTR0TutJimllLkII0Ts1UxHVT4475s7UI-5uK5aNVzYOSUMxaGRq9ZaCGPwi2wkROzwm6JUQLDfLI Sep 01 14:15:09.268983 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Id: None Sep 01 14:15:09.268983 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Name: None Sep 01 14:15:09.268983 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Identity-Status: Confirmed Sep 01 14:15:09.268983 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Is-Admin-Project: True Sep 01 14:15:09.268983 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Id: default Sep 01 14:15:09.268983 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Name: Default Sep 01 14:15:09.268983 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Id: 90a84500a899479aabfa3aeb72b4c4ae Sep 01 14:15:09.268983 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Name: tempest-AttachVolumeNegativeTest-836381067 Sep 01 14:15:09.268983 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Role: member,reader Sep 01 14:15:09.268983 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Roles: member,reader Sep 01 14:15:09.270657 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/90a84500a899479aabfa3aeb72b4c4ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/90a84500a899479aabfa3aeb72b4c4ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/90a84500a899479aabfa3aeb72b4c4ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_90a84500a899479aabfa3aeb72b4c4ae"}]}] Sep 01 14:15:09.270657 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant: tempest-AttachVolumeNegativeTest-836381067 Sep 01 14:15:09.270657 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Id: 90a84500a899479aabfa3aeb72b4c4ae Sep 01 14:15:09.270657 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-836381067 Sep 01 14:15:09.270657 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User: tempest-AttachVolumeNegativeTest-836381067-project Sep 01 14:15:09.270657 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Id: default Sep 01 14:15:09.270657 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Name: Default Sep 01 14:15:09.270657 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Id: 7ae66df61a764a42a1b1b15f54d5c34b Sep 01 14:15:09.270657 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Name: tempest-AttachVolumeNegativeTest-836381067-project Sep 01 14:15:09.270657 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: method: > Sep 01 14:15:09.270657 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: exception: Instance 91814986-adf4-46cb-8edf-820106d37ecb could not be found. Sep 01 14:15:09.270657 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: action_args: {'id': '91814986-adf4-46cb-8edf-820106d37ecb'} Sep 01 14:15:09.271533 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:15:09.271533 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:09.271533 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:15:09.271533 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:15:09.271533 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:15:09.271533 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:15:09.271533 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:15:09.271533 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:15:09.271533 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:15:09.271533 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:15:09.271533 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91814986-adf4-46cb-8edf-820106d37ecb could not be found. Sep 01 14:15:09.271533 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:15:09.271533 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:15:09.271533 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:15:09.271533 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:09.271533 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:15:09.271533 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:15:09.271533 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:15:09.271533 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:15:09.271533 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:15:09.272837 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:15:09.272837 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 14:15:09.272837 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 14:15:09.272837 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 14:15:09.272837 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 14:15:09.272837 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:15:09.272837 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:15:09.272837 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:15:09.272837 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:15:09.272837 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91814986-adf4-46cb-8edf-820106d37ecb could not be found. Sep 01 14:15:09.272837 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:15:09.272837 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:15:09.272837 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:15:09.272837 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:09.272837 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:15:09.272837 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:15:09.272837 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:15:09.272837 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:15:09.272837 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91814986-adf4-46cb-8edf-820106d37ecb could not be found. Sep 01 14:15:09.272837 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:15:09.274188 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-fdfde4f8-b4e2-45c6-8ac9-fa76ff5bf73e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Returning 404 to user: Instance 91814986-adf4-46cb-8edf-820106d37ecb could not be found. {{(pid=121340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:15:09.274188 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-fdfde4f8-b4e2-45c6-8ac9-fa76ff5bf73e tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "DELETE /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb" status: 404 len: 111 microversion: 2.1 time: 0.094140 Sep 01 14:15:09.274188 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 555/1103] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 14:15:09 2022] DELETE /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 14:15:09.290278 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-47197503-2432-4aca-b879-3d00cf0f7b6d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:15:09.292361 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-47197503-2432-4aca-b879-3d00cf0f7b6d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] [instance: 91814986-adf4-46cb-8edf-820106d37ecb] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:15:09.304964 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-47197503-2432-4aca-b879-3d00cf0f7b6d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:09.305779 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-47197503-2432-4aca-b879-3d00cf0f7b6d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:09.306569 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-47197503-2432-4aca-b879-3d00cf0f7b6d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:09.307873 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-47197503-2432-4aca-b879-3d00cf0f7b6d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:09.308784 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-47197503-2432-4aca-b879-3d00cf0f7b6d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:09.309306 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-47197503-2432-4aca-b879-3d00cf0f7b6d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:09.329955 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.wsgi [None req-47197503-2432-4aca-b879-3d00cf0f7b6d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] HTTP exception thrown: Instance 91814986-adf4-46cb-8edf-820106d37ecb could not be found. Sep 01 14:15:09.332142 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-47197503-2432-4aca-b879-3d00cf0f7b6d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Request method failure captured: Sep 01 14:15:09.332142 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: request: GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb HTTP/1.1 Sep 01 14:15:09.332142 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept: application/json Sep 01 14:15:09.332142 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept-Encoding: identity Sep 01 14:15:09.332142 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Connection: close Sep 01 14:15:09.332142 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Length: 0 Sep 01 14:15:09.332142 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Type: application/json Sep 01 14:15:09.332142 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Host: 10.222.0.25 Sep 01 14:15:09.332142 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Openstack-System-Scope: None Sep 01 14:15:09.332142 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: User-Agent: python-urllib3/1.26.12 Sep 01 14:15:09.332142 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Auth-Token: gAAAAABjELyhZj5Hr9I4grX9g-sLmSzxOFwV6C8_UuPsJu0TTboeG4lPJ1EtlgmTO6Q18ohdm_zKgQxmrLRlDi5SpU-ZjSVzLIRa5u6LBsCTR0TutJimllLkII0Ts1UxHVT4475s7UI-5uK5aNVzYOSUMxaGRq9ZaCGPwi2wkROzwm6JUQLDfLI Sep 01 14:15:09.332142 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Id: None Sep 01 14:15:09.332142 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Name: None Sep 01 14:15:09.332142 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Identity-Status: Confirmed Sep 01 14:15:09.332142 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Is-Admin-Project: True Sep 01 14:15:09.332142 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Id: default Sep 01 14:15:09.332142 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Name: Default Sep 01 14:15:09.332142 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Id: 90a84500a899479aabfa3aeb72b4c4ae Sep 01 14:15:09.332142 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Name: tempest-AttachVolumeNegativeTest-836381067 Sep 01 14:15:09.332142 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Role: member,reader Sep 01 14:15:09.332142 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Roles: member,reader Sep 01 14:15:09.334830 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/90a84500a899479aabfa3aeb72b4c4ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/90a84500a899479aabfa3aeb72b4c4ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/90a84500a899479aabfa3aeb72b4c4ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_90a84500a899479aabfa3aeb72b4c4ae"}]}] Sep 01 14:15:09.334830 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant: tempest-AttachVolumeNegativeTest-836381067 Sep 01 14:15:09.334830 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Id: 90a84500a899479aabfa3aeb72b4c4ae Sep 01 14:15:09.334830 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-836381067 Sep 01 14:15:09.334830 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User: tempest-AttachVolumeNegativeTest-836381067-project Sep 01 14:15:09.334830 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Id: default Sep 01 14:15:09.334830 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Name: Default Sep 01 14:15:09.334830 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Id: 7ae66df61a764a42a1b1b15f54d5c34b Sep 01 14:15:09.334830 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Name: tempest-AttachVolumeNegativeTest-836381067-project Sep 01 14:15:09.334830 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: method: > Sep 01 14:15:09.334830 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: exception: Instance 91814986-adf4-46cb-8edf-820106d37ecb could not be found. Sep 01 14:15:09.334830 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: action_args: {'id': '91814986-adf4-46cb-8edf-820106d37ecb'} Sep 01 14:15:09.337616 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:15:09.337616 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:09.337616 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:15:09.337616 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:15:09.337616 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:15:09.337616 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:15:09.337616 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:15:09.337616 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:15:09.337616 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:15:09.337616 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:15:09.337616 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91814986-adf4-46cb-8edf-820106d37ecb could not be found. Sep 01 14:15:09.337616 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:15:09.337616 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:15:09.337616 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:15:09.337616 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:09.337616 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:15:09.337616 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:15:09.337616 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:15:09.337616 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:15:09.337616 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:15:09.341723 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:15:09.341723 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:15:09.341723 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:15:09.341723 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:15:09.341723 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:15:09.341723 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:15:09.341723 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:15:09.341723 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91814986-adf4-46cb-8edf-820106d37ecb could not be found. Sep 01 14:15:09.341723 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:15:09.341723 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:15:09.341723 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:15:09.341723 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:09.341723 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:15:09.341723 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:15:09.341723 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:15:09.341723 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:15:09.341723 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91814986-adf4-46cb-8edf-820106d37ecb could not be found. Sep 01 14:15:09.341723 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:15:09.346214 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-47197503-2432-4aca-b879-3d00cf0f7b6d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] Returning 404 to user: Instance 91814986-adf4-46cb-8edf-820106d37ecb could not be found. {{(pid=121339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:15:09.346214 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-47197503-2432-4aca-b879-3d00cf0f7b6d tempest-AttachVolumeNegativeTest-836381067 tempest-AttachVolumeNegativeTest-836381067-project] 10.222.0.25 "GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb" status: 404 len: 111 microversion: 2.1 time: 0.055395 Sep 01 14:15:09.346214 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 549/1104] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:15:09 2022] GET /compute/v2.1/servers/91814986-adf4-46cb-8edf-820106d37ecb => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 14:15:33.040672 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-82577f0a-5b42-44d6-b732-f50f02bda4e7 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1991392838", "imageRef": "9be77128-e763-4225-b76f-85fbb04ad9b2", "flavorRef": "452", "networks": [{"uuid": "b4e12ec0-72a1-4de6-85a2-65af038c9b2d"}]}} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:15:33.074211 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_api:SELECT=15 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:15:33.077299 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell1:SELECT=39,nova_cell1:INSERT=1 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:15:33.147811 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.network.neutron [None req-82577f0a-5b42-44d6-b732-f50f02bda4e7 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] validate_networks() for [('b4e12ec0-72a1-4de6-85a2-65af038c9b2d', None, None, None, None, None)] {{(pid=121340) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:15:33.752674 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-82577f0a-5b42-44d6-b732-f50f02bda4e7 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Flavor limits 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:15:33.753371 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-82577f0a-5b42-44d6-b732-f50f02bda4e7 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Image limits 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:15:33.755694 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-82577f0a-5b42-44d6-b732-f50f02bda4e7 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Flavor pref 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:15:33.755694 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-82577f0a-5b42-44d6-b732-f50f02bda4e7 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Image pref 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:15:33.755694 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-82577f0a-5b42-44d6-b732-f50f02bda4e7 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:15:33.765862 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-82577f0a-5b42-44d6-b732-f50f02bda4e7 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:33.766478 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-82577f0a-5b42-44d6-b732-f50f02bda4e7 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:33.767012 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-82577f0a-5b42-44d6-b732-f50f02bda4e7 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:33.767764 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-82577f0a-5b42-44d6-b732-f50f02bda4e7 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:33.768216 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-82577f0a-5b42-44d6-b732-f50f02bda4e7 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:33.768736 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-82577f0a-5b42-44d6-b732-f50f02bda4e7 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:33.789855 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.quota [None req-82577f0a-5b42-44d6-b732-f50f02bda4e7 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Getting quotas for project 493732d3c282440f8593558858bb0b33. Resources: {'cores', 'instances', 'ram'} {{(pid=121340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:15:33.796775 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.quota [None req-82577f0a-5b42-44d6-b732-f50f02bda4e7 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Getting quotas for user 176ac62de5974fef91b59293df718ebc and project 493732d3c282440f8593558858bb0b33. Resources: {'cores', 'instances', 'ram'} {{(pid=121340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:15:33.816862 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-82577f0a-5b42-44d6-b732-f50f02bda4e7 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Going to run 1 instances... {{(pid=121340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:15:33.821650 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-82577f0a-5b42-44d6-b732-f50f02bda4e7 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] [instance: 24238b06-aad3-47d2-ad13-a91926a0634d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9be77128-e763-4225-b76f-85fbb04ad9b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:15:34.117930 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-82577f0a-5b42-44d6-b732-f50f02bda4e7 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.083555 Sep 01 14:15:34.120717 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 556/1105] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 1 14:15:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1088 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 14:15:34.144299 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-cb5734c2-aaee-4222-b041-7cc2bb6e802e tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:15:34.145359 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-cb5734c2-aaee-4222-b041-7cc2bb6e802e tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] [instance: 24238b06-aad3-47d2-ad13-a91926a0634d] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:15:34.157588 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:15:34.158565 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:15:34.230130 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-cb5734c2-aaee-4222-b041-7cc2bb6e802e tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176ac62de5974fef91b59293df718ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493732d3c282440f8593558858bb0b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:15:34.238058 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-cb5734c2-aaee-4222-b041-7cc2bb6e802e tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] 10.222.0.25 "GET /compute/v2.1/servers/24238b06-aad3-47d2-ad13-a91926a0634d" status: 200 len: 1214 microversion: 2.1 time: 0.104655 Sep 01 14:15:34.242395 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 550/1106] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:15:34 2022] GET /compute/v2.1/servers/24238b06-aad3-47d2-ad13-a91926a0634d => generated 1214 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:15:35.264861 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-1ac7c2cf-ae1d-4bef-b1ef-b5a43c67dc1c tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:15:35.265785 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-1ac7c2cf-ae1d-4bef-b1ef-b5a43c67dc1c tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] [instance: 24238b06-aad3-47d2-ad13-a91926a0634d] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:15:35.333266 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-1ac7c2cf-ae1d-4bef-b1ef-b5a43c67dc1c tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176ac62de5974fef91b59293df718ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493732d3c282440f8593558858bb0b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:15:35.347562 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-1ac7c2cf-ae1d-4bef-b1ef-b5a43c67dc1c tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] 10.222.0.25 "GET /compute/v2.1/servers/24238b06-aad3-47d2-ad13-a91926a0634d" status: 200 len: 1214 microversion: 2.1 time: 0.087933 Sep 01 14:15:35.349345 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 557/1107] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:15:35 2022] GET /compute/v2.1/servers/24238b06-aad3-47d2-ad13-a91926a0634d => generated 1214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:15:36.370769 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-a65f6f9b-f306-47f0-96ce-2da71de4087a tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:15:36.371357 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-a65f6f9b-f306-47f0-96ce-2da71de4087a tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] [instance: 24238b06-aad3-47d2-ad13-a91926a0634d] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:15:36.380698 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a65f6f9b-f306-47f0-96ce-2da71de4087a tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:36.381183 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a65f6f9b-f306-47f0-96ce-2da71de4087a tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:36.381622 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a65f6f9b-f306-47f0-96ce-2da71de4087a tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:36.382406 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a65f6f9b-f306-47f0-96ce-2da71de4087a tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:36.382867 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a65f6f9b-f306-47f0-96ce-2da71de4087a tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:36.383293 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a65f6f9b-f306-47f0-96ce-2da71de4087a tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:36.511887 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-a65f6f9b-f306-47f0-96ce-2da71de4087a tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176ac62de5974fef91b59293df718ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493732d3c282440f8593558858bb0b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:15:36.530841 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-a65f6f9b-f306-47f0-96ce-2da71de4087a tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] 10.222.0.25 "GET /compute/v2.1/servers/24238b06-aad3-47d2-ad13-a91926a0634d" status: 200 len: 1210 microversion: 2.1 time: 0.164001 Sep 01 14:15:36.532227 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 551/1108] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:15:36 2022] GET /compute/v2.1/servers/24238b06-aad3-47d2-ad13-a91926a0634d => generated 1210 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:15:37.563893 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-1744d8c5-374b-4ef4-be71-4c14792891c5 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:15:37.564709 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-1744d8c5-374b-4ef4-be71-4c14792891c5 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] [instance: 24238b06-aad3-47d2-ad13-a91926a0634d] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:15:37.571937 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1744d8c5-374b-4ef4-be71-4c14792891c5 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:37.572666 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1744d8c5-374b-4ef4-be71-4c14792891c5 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:37.573291 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1744d8c5-374b-4ef4-be71-4c14792891c5 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:37.574200 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1744d8c5-374b-4ef4-be71-4c14792891c5 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:37.574762 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1744d8c5-374b-4ef4-be71-4c14792891c5 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:37.575289 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1744d8c5-374b-4ef4-be71-4c14792891c5 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:37.685943 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-1744d8c5-374b-4ef4-be71-4c14792891c5 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176ac62de5974fef91b59293df718ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493732d3c282440f8593558858bb0b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:15:37.702836 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-1744d8c5-374b-4ef4-be71-4c14792891c5 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] 10.222.0.25 "GET /compute/v2.1/servers/24238b06-aad3-47d2-ad13-a91926a0634d" status: 200 len: 1266 microversion: 2.1 time: 0.142791 Sep 01 14:15:37.703517 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 558/1109] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:15:37 2022] GET /compute/v2.1/servers/24238b06-aad3-47d2-ad13-a91926a0634d => generated 1266 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:15:38.729948 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-13e74519-332a-41a2-9bc8-6d7a0f2a3b7c tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:15:38.730897 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-13e74519-332a-41a2-9bc8-6d7a0f2a3b7c tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] [instance: 24238b06-aad3-47d2-ad13-a91926a0634d] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:15:38.739037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-13e74519-332a-41a2-9bc8-6d7a0f2a3b7c tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:38.739541 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-13e74519-332a-41a2-9bc8-6d7a0f2a3b7c tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:38.739992 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-13e74519-332a-41a2-9bc8-6d7a0f2a3b7c tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:38.740891 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-13e74519-332a-41a2-9bc8-6d7a0f2a3b7c tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:38.741387 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-13e74519-332a-41a2-9bc8-6d7a0f2a3b7c tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:38.742088 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-13e74519-332a-41a2-9bc8-6d7a0f2a3b7c tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:39.334317 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-13e74519-332a-41a2-9bc8-6d7a0f2a3b7c tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176ac62de5974fef91b59293df718ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493732d3c282440f8593558858bb0b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:15:39.353037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-13e74519-332a-41a2-9bc8-6d7a0f2a3b7c tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] 10.222.0.25 "GET /compute/v2.1/servers/24238b06-aad3-47d2-ad13-a91926a0634d" status: 200 len: 1314 microversion: 2.1 time: 0.628820 Sep 01 14:15:39.354747 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 552/1110] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:15:38 2022] GET /compute/v2.1/servers/24238b06-aad3-47d2-ad13-a91926a0634d => generated 1314 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:15:40.359896 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [req-5baa435d-21ce-4bec-ab87-155c1cb32c63 req-5738ba7a-4417-4b69-81f7-3fd7f540b5c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24238b06-aad3-47d2-ad13-a91926a0634d", "tag": "e9364631-16e8-4942-9d25-6d57b908924e"}]} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:15:40.381707 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-a846c2c1-0a69-4742-84c0-dfdb4624cfdc tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:15:40.383917 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-a846c2c1-0a69-4742-84c0-dfdb4624cfdc tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] [instance: 24238b06-aad3-47d2-ad13-a91926a0634d] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:15:40.402063 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-5baa435d-21ce-4bec-ab87-155c1cb32c63 req-5738ba7a-4417-4b69-81f7-3fd7f540b5c0 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:40.402939 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-5baa435d-21ce-4bec-ab87-155c1cb32c63 req-5738ba7a-4417-4b69-81f7-3fd7f540b5c0 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:40.403730 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-5baa435d-21ce-4bec-ab87-155c1cb32c63 req-5738ba7a-4417-4b69-81f7-3fd7f540b5c0 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:40.413443 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a846c2c1-0a69-4742-84c0-dfdb4624cfdc tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:40.414782 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a846c2c1-0a69-4742-84c0-dfdb4624cfdc tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:40.416089 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a846c2c1-0a69-4742-84c0-dfdb4624cfdc tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:40.417459 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a846c2c1-0a69-4742-84c0-dfdb4624cfdc tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:40.418336 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a846c2c1-0a69-4742-84c0-dfdb4624cfdc tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:40.419103 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a846c2c1-0a69-4742-84c0-dfdb4624cfdc tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:40.436651 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.compute.server_external_events [req-5baa435d-21ce-4bec-ab87-155c1cb32c63 req-5738ba7a-4417-4b69-81f7-3fd7f540b5c0 service nova] Creating event network-changed:e9364631-16e8-4942-9d25-6d57b908924e for instance 24238b06-aad3-47d2-ad13-a91926a0634d on hv-cinder-85221 Sep 01 14:15:40.446309 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [req-5baa435d-21ce-4bec-ab87-155c1cb32c63 req-5738ba7a-4417-4b69-81f7-3fd7f540b5c0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092802 Sep 01 14:15:40.448338 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 559/1111] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:15:40.642762 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-a846c2c1-0a69-4742-84c0-dfdb4624cfdc tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176ac62de5974fef91b59293df718ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493732d3c282440f8593558858bb0b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:15:40.658159 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-a846c2c1-0a69-4742-84c0-dfdb4624cfdc tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] 10.222.0.25 "GET /compute/v2.1/servers/24238b06-aad3-47d2-ad13-a91926a0634d" status: 200 len: 1314 microversion: 2.1 time: 0.283902 Sep 01 14:15:40.660137 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 553/1112] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:15:40 2022] GET /compute/v2.1/servers/24238b06-aad3-47d2-ad13-a91926a0634d => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:15:41.687680 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-187c4199-83d0-4f44-aee0-36c5ee6032a3 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:15:41.688801 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-187c4199-83d0-4f44-aee0-36c5ee6032a3 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] [instance: 24238b06-aad3-47d2-ad13-a91926a0634d] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:15:41.702304 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-187c4199-83d0-4f44-aee0-36c5ee6032a3 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:41.702304 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-187c4199-83d0-4f44-aee0-36c5ee6032a3 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:41.702304 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-187c4199-83d0-4f44-aee0-36c5ee6032a3 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:41.702304 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-187c4199-83d0-4f44-aee0-36c5ee6032a3 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:41.703216 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-187c4199-83d0-4f44-aee0-36c5ee6032a3 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:41.703574 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-187c4199-83d0-4f44-aee0-36c5ee6032a3 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:42.084523 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-187c4199-83d0-4f44-aee0-36c5ee6032a3 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176ac62de5974fef91b59293df718ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493732d3c282440f8593558858bb0b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:15:42.093723 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-187c4199-83d0-4f44-aee0-36c5ee6032a3 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] 10.222.0.25 "GET /compute/v2.1/servers/24238b06-aad3-47d2-ad13-a91926a0634d" status: 200 len: 1314 microversion: 2.1 time: 0.415362 Sep 01 14:15:42.094353 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 560/1113] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:15:41 2022] GET /compute/v2.1/servers/24238b06-aad3-47d2-ad13-a91926a0634d => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:15:43.120627 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-e816e411-a195-4c84-9138-21366f058bad tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:15:43.121703 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-e816e411-a195-4c84-9138-21366f058bad tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] [instance: 24238b06-aad3-47d2-ad13-a91926a0634d] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:15:43.130499 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e816e411-a195-4c84-9138-21366f058bad tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:43.132172 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e816e411-a195-4c84-9138-21366f058bad tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:43.132931 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e816e411-a195-4c84-9138-21366f058bad tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:43.133823 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e816e411-a195-4c84-9138-21366f058bad tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:43.136057 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e816e411-a195-4c84-9138-21366f058bad tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:43.136792 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e816e411-a195-4c84-9138-21366f058bad tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:43.304424 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-e816e411-a195-4c84-9138-21366f058bad tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176ac62de5974fef91b59293df718ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493732d3c282440f8593558858bb0b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:15:43.314357 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-e816e411-a195-4c84-9138-21366f058bad tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] 10.222.0.25 "GET /compute/v2.1/servers/24238b06-aad3-47d2-ad13-a91926a0634d" status: 200 len: 1314 microversion: 2.1 time: 0.200099 Sep 01 14:15:43.314960 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 554/1114] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:15:43 2022] GET /compute/v2.1/servers/24238b06-aad3-47d2-ad13-a91926a0634d => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:15:44.339763 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-ed4198b6-85ba-4c8d-b34d-50e234ac476c tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:15:44.341824 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-ed4198b6-85ba-4c8d-b34d-50e234ac476c tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] [instance: 24238b06-aad3-47d2-ad13-a91926a0634d] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:15:44.345617 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell0:SELECT=2 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:15:44.353802 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ed4198b6-85ba-4c8d-b34d-50e234ac476c tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:44.354591 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ed4198b6-85ba-4c8d-b34d-50e234ac476c tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:44.355237 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ed4198b6-85ba-4c8d-b34d-50e234ac476c tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:44.356261 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ed4198b6-85ba-4c8d-b34d-50e234ac476c tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:44.357070 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ed4198b6-85ba-4c8d-b34d-50e234ac476c tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:44.357973 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ed4198b6-85ba-4c8d-b34d-50e234ac476c tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:44.546109 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-ed4198b6-85ba-4c8d-b34d-50e234ac476c tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176ac62de5974fef91b59293df718ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493732d3c282440f8593558858bb0b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:15:44.570825 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-ed4198b6-85ba-4c8d-b34d-50e234ac476c tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] 10.222.0.25 "GET /compute/v2.1/servers/24238b06-aad3-47d2-ad13-a91926a0634d" status: 200 len: 1314 microversion: 2.1 time: 0.225936 Sep 01 14:15:44.578268 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 561/1115] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:15:44 2022] GET /compute/v2.1/servers/24238b06-aad3-47d2-ad13-a91926a0634d => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:15:45.586588 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-55eb9fb6-dd56-4d41-b165-d8689b50e463 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:15:45.587545 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-55eb9fb6-dd56-4d41-b165-d8689b50e463 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] [instance: 24238b06-aad3-47d2-ad13-a91926a0634d] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:15:45.589888 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell0:SELECT=2 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:15:45.595472 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-55eb9fb6-dd56-4d41-b165-d8689b50e463 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:45.596028 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-55eb9fb6-dd56-4d41-b165-d8689b50e463 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:45.596474 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-55eb9fb6-dd56-4d41-b165-d8689b50e463 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:45.597297 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-55eb9fb6-dd56-4d41-b165-d8689b50e463 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:45.597770 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-55eb9fb6-dd56-4d41-b165-d8689b50e463 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:45.598282 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-55eb9fb6-dd56-4d41-b165-d8689b50e463 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:45.775060 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-55eb9fb6-dd56-4d41-b165-d8689b50e463 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176ac62de5974fef91b59293df718ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493732d3c282440f8593558858bb0b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:15:45.784970 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-55eb9fb6-dd56-4d41-b165-d8689b50e463 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] 10.222.0.25 "GET /compute/v2.1/servers/24238b06-aad3-47d2-ad13-a91926a0634d" status: 200 len: 1314 microversion: 2.1 time: 0.203325 Sep 01 14:15:45.785580 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 555/1116] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:15:45 2022] GET /compute/v2.1/servers/24238b06-aad3-47d2-ad13-a91926a0634d => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:15:46.527144 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [req-daac192b-7e68-407f-86ce-181be137d54e req-129ba362-c762-4ec7-a1aa-a8d5f964e14d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24238b06-aad3-47d2-ad13-a91926a0634d", "name": "network-vif-plugged", "status": "completed", "tag": "e9364631-16e8-4942-9d25-6d57b908924e"}]} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:15:46.532426 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell0:SELECT=8 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:15:46.539841 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-daac192b-7e68-407f-86ce-181be137d54e req-129ba362-c762-4ec7-a1aa-a8d5f964e14d service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:46.541692 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-daac192b-7e68-407f-86ce-181be137d54e req-129ba362-c762-4ec7-a1aa-a8d5f964e14d service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:46.542285 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-daac192b-7e68-407f-86ce-181be137d54e req-129ba362-c762-4ec7-a1aa-a8d5f964e14d service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:46.555338 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.compute.server_external_events [req-daac192b-7e68-407f-86ce-181be137d54e req-129ba362-c762-4ec7-a1aa-a8d5f964e14d service nova] Creating event network-vif-plugged:e9364631-16e8-4942-9d25-6d57b908924e for instance 24238b06-aad3-47d2-ad13-a91926a0634d on hv-cinder-85221 Sep 01 14:15:46.561683 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [req-daac192b-7e68-407f-86ce-181be137d54e req-129ba362-c762-4ec7-a1aa-a8d5f964e14d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039382 Sep 01 14:15:46.562285 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 562/1117] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:15:46.814647 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-3bebba26-4251-48e9-9ada-e1e92eae74bb tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:15:46.815690 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-3bebba26-4251-48e9-9ada-e1e92eae74bb tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] [instance: 24238b06-aad3-47d2-ad13-a91926a0634d] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:15:46.827574 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3bebba26-4251-48e9-9ada-e1e92eae74bb tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:46.828782 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3bebba26-4251-48e9-9ada-e1e92eae74bb tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:46.829554 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3bebba26-4251-48e9-9ada-e1e92eae74bb tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:46.835142 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3bebba26-4251-48e9-9ada-e1e92eae74bb tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:46.835142 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3bebba26-4251-48e9-9ada-e1e92eae74bb tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:46.835142 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3bebba26-4251-48e9-9ada-e1e92eae74bb tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:47.057624 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-3bebba26-4251-48e9-9ada-e1e92eae74bb tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176ac62de5974fef91b59293df718ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493732d3c282440f8593558858bb0b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:15:47.075955 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-3bebba26-4251-48e9-9ada-e1e92eae74bb tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] 10.222.0.25 "GET /compute/v2.1/servers/24238b06-aad3-47d2-ad13-a91926a0634d" status: 200 len: 1314 microversion: 2.1 time: 0.269608 Sep 01 14:15:47.076842 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 556/1118] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:15:46 2022] GET /compute/v2.1/servers/24238b06-aad3-47d2-ad13-a91926a0634d => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:15:48.106086 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-c530cc60-3879-4173-8246-af045f41b55b tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:15:48.107633 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-c530cc60-3879-4173-8246-af045f41b55b tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] [instance: 24238b06-aad3-47d2-ad13-a91926a0634d] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:15:48.121364 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c530cc60-3879-4173-8246-af045f41b55b tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:48.122309 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c530cc60-3879-4173-8246-af045f41b55b tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:48.123235 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c530cc60-3879-4173-8246-af045f41b55b tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:48.124606 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c530cc60-3879-4173-8246-af045f41b55b tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:48.125539 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c530cc60-3879-4173-8246-af045f41b55b tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:48.126451 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c530cc60-3879-4173-8246-af045f41b55b tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:48.336408 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-c530cc60-3879-4173-8246-af045f41b55b tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176ac62de5974fef91b59293df718ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493732d3c282440f8593558858bb0b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:15:48.347315 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-c530cc60-3879-4173-8246-af045f41b55b tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] 10.222.0.25 "GET /compute/v2.1/servers/24238b06-aad3-47d2-ad13-a91926a0634d" status: 200 len: 1314 microversion: 2.1 time: 0.249010 Sep 01 14:15:48.348023 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 563/1119] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:15:48 2022] GET /compute/v2.1/servers/24238b06-aad3-47d2-ad13-a91926a0634d => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:15:49.382419 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-3ab6e1dc-c1d6-48e9-b35b-6d5647a4d253 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:15:49.383263 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-3ab6e1dc-c1d6-48e9-b35b-6d5647a4d253 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] [instance: 24238b06-aad3-47d2-ad13-a91926a0634d] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:15:49.399323 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3ab6e1dc-c1d6-48e9-b35b-6d5647a4d253 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:49.399853 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3ab6e1dc-c1d6-48e9-b35b-6d5647a4d253 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:49.400122 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3ab6e1dc-c1d6-48e9-b35b-6d5647a4d253 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:49.400857 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3ab6e1dc-c1d6-48e9-b35b-6d5647a4d253 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:49.401313 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3ab6e1dc-c1d6-48e9-b35b-6d5647a4d253 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:49.401764 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-3ab6e1dc-c1d6-48e9-b35b-6d5647a4d253 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:49.581794 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-3ab6e1dc-c1d6-48e9-b35b-6d5647a4d253 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176ac62de5974fef91b59293df718ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493732d3c282440f8593558858bb0b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:15:49.590899 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-3ab6e1dc-c1d6-48e9-b35b-6d5647a4d253 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] 10.222.0.25 "GET /compute/v2.1/servers/24238b06-aad3-47d2-ad13-a91926a0634d" status: 200 len: 1498 microversion: 2.1 time: 0.218498 Sep 01 14:15:49.591753 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 557/1120] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:15:49 2022] GET /compute/v2.1/servers/24238b06-aad3-47d2-ad13-a91926a0634d => generated 1498 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:15:50.908290 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-d3c961e9-7f81-46d2-bec5-e281edd94d31 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:15:50.909084 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-d3c961e9-7f81-46d2-bec5-e281edd94d31 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] [instance: 24238b06-aad3-47d2-ad13-a91926a0634d] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:15:50.921285 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d3c961e9-7f81-46d2-bec5-e281edd94d31 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:50.922168 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d3c961e9-7f81-46d2-bec5-e281edd94d31 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:50.922915 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d3c961e9-7f81-46d2-bec5-e281edd94d31 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:50.924180 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d3c961e9-7f81-46d2-bec5-e281edd94d31 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:50.925031 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d3c961e9-7f81-46d2-bec5-e281edd94d31 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:50.925829 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-d3c961e9-7f81-46d2-bec5-e281edd94d31 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:50.975719 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-d3c961e9-7f81-46d2-bec5-e281edd94d31 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] [instance: 24238b06-aad3-47d2-ad13-a91926a0634d] Going to try to terminate instance {{(pid=121340) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:15:51.473509 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-d3c961e9-7f81-46d2-bec5-e281edd94d31 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] 10.222.0.25 "DELETE /compute/v2.1/servers/24238b06-aad3-47d2-ad13-a91926a0634d" status: 204 len: 0 microversion: 2.1 time: 0.571592 Sep 01 14:15:51.474393 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 564/1121] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 14:15:50 2022] DELETE /compute/v2.1/servers/24238b06-aad3-47d2-ad13-a91926a0634d => generated 0 bytes in 574 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:15:51.483611 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-72e2971c-1031-4464-8eaa-9aebb7784c13 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:15:51.484468 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-72e2971c-1031-4464-8eaa-9aebb7784c13 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] [instance: 24238b06-aad3-47d2-ad13-a91926a0634d] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:15:51.492268 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-72e2971c-1031-4464-8eaa-9aebb7784c13 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:51.492898 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-72e2971c-1031-4464-8eaa-9aebb7784c13 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:51.493448 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-72e2971c-1031-4464-8eaa-9aebb7784c13 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:51.494498 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-72e2971c-1031-4464-8eaa-9aebb7784c13 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:51.495161 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-72e2971c-1031-4464-8eaa-9aebb7784c13 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:51.495688 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-72e2971c-1031-4464-8eaa-9aebb7784c13 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:51.652729 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-72e2971c-1031-4464-8eaa-9aebb7784c13 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176ac62de5974fef91b59293df718ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493732d3c282440f8593558858bb0b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:15:51.661704 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-72e2971c-1031-4464-8eaa-9aebb7784c13 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] 10.222.0.25 "GET /compute/v2.1/servers/24238b06-aad3-47d2-ad13-a91926a0634d" status: 200 len: 1504 microversion: 2.1 time: 0.182199 Sep 01 14:15:51.662320 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 558/1122] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:15:51 2022] GET /compute/v2.1/servers/24238b06-aad3-47d2-ad13-a91926a0634d => generated 1504 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:15:52.684343 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-c61bb10b-8651-462f-a88b-00d0bd5dab59 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:15:52.685198 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-c61bb10b-8651-462f-a88b-00d0bd5dab59 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] [instance: 24238b06-aad3-47d2-ad13-a91926a0634d] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:15:52.694888 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c61bb10b-8651-462f-a88b-00d0bd5dab59 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:52.695721 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c61bb10b-8651-462f-a88b-00d0bd5dab59 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:52.696552 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c61bb10b-8651-462f-a88b-00d0bd5dab59 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:52.697855 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c61bb10b-8651-462f-a88b-00d0bd5dab59 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:52.698769 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c61bb10b-8651-462f-a88b-00d0bd5dab59 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:52.699545 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c61bb10b-8651-462f-a88b-00d0bd5dab59 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:52.863460 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-c61bb10b-8651-462f-a88b-00d0bd5dab59 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176ac62de5974fef91b59293df718ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493732d3c282440f8593558858bb0b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:15:52.872530 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-c61bb10b-8651-462f-a88b-00d0bd5dab59 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] 10.222.0.25 "GET /compute/v2.1/servers/24238b06-aad3-47d2-ad13-a91926a0634d" status: 200 len: 1504 microversion: 2.1 time: 0.192965 Sep 01 14:15:52.873121 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 565/1123] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:15:52 2022] GET /compute/v2.1/servers/24238b06-aad3-47d2-ad13-a91926a0634d => generated 1504 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:15:53.898945 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-eb2b2417-f583-4a27-b1c8-9ce75409d5d6 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:15:53.906536 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-eb2b2417-f583-4a27-b1c8-9ce75409d5d6 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] [instance: 24238b06-aad3-47d2-ad13-a91926a0634d] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:15:53.911000 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-eb2b2417-f583-4a27-b1c8-9ce75409d5d6 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:53.911876 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-eb2b2417-f583-4a27-b1c8-9ce75409d5d6 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:53.912642 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-eb2b2417-f583-4a27-b1c8-9ce75409d5d6 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:53.913614 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-eb2b2417-f583-4a27-b1c8-9ce75409d5d6 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:53.914226 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-eb2b2417-f583-4a27-b1c8-9ce75409d5d6 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:53.914673 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-eb2b2417-f583-4a27-b1c8-9ce75409d5d6 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:54.068619 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-eb2b2417-f583-4a27-b1c8-9ce75409d5d6 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176ac62de5974fef91b59293df718ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493732d3c282440f8593558858bb0b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:15:54.077631 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-eb2b2417-f583-4a27-b1c8-9ce75409d5d6 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] 10.222.0.25 "GET /compute/v2.1/servers/24238b06-aad3-47d2-ad13-a91926a0634d" status: 200 len: 1504 microversion: 2.1 time: 0.185912 Sep 01 14:15:54.078343 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 559/1124] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:15:53 2022] GET /compute/v2.1/servers/24238b06-aad3-47d2-ad13-a91926a0634d => generated 1504 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:15:55.106243 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-b069a0b1-37c0-46f6-8447-1e40aa4bc632 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:15:55.107408 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-b069a0b1-37c0-46f6-8447-1e40aa4bc632 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] [instance: 24238b06-aad3-47d2-ad13-a91926a0634d] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:15:55.123761 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b069a0b1-37c0-46f6-8447-1e40aa4bc632 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:55.124635 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b069a0b1-37c0-46f6-8447-1e40aa4bc632 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:55.125283 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b069a0b1-37c0-46f6-8447-1e40aa4bc632 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:55.126503 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b069a0b1-37c0-46f6-8447-1e40aa4bc632 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:55.127270 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b069a0b1-37c0-46f6-8447-1e40aa4bc632 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:55.128021 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b069a0b1-37c0-46f6-8447-1e40aa4bc632 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:55.319594 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-b069a0b1-37c0-46f6-8447-1e40aa4bc632 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176ac62de5974fef91b59293df718ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493732d3c282440f8593558858bb0b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:15:55.328430 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-b069a0b1-37c0-46f6-8447-1e40aa4bc632 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] 10.222.0.25 "GET /compute/v2.1/servers/24238b06-aad3-47d2-ad13-a91926a0634d" status: 200 len: 1504 microversion: 2.1 time: 0.230004 Sep 01 14:15:55.329030 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 566/1125] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:15:55 2022] GET /compute/v2.1/servers/24238b06-aad3-47d2-ad13-a91926a0634d => generated 1504 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:15:56.126907 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [req-fe48a748-c255-4277-8163-8ea5a65d0fb5 req-b81569ac-e5fa-409b-86ac-65d1e5933c11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24238b06-aad3-47d2-ad13-a91926a0634d", "name": "network-vif-deleted", "tag": "e9364631-16e8-4942-9d25-6d57b908924e"}]} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:15:56.147426 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-fe48a748-c255-4277-8163-8ea5a65d0fb5 req-b81569ac-e5fa-409b-86ac-65d1e5933c11 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:56.148498 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-fe48a748-c255-4277-8163-8ea5a65d0fb5 req-b81569ac-e5fa-409b-86ac-65d1e5933c11 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:56.148983 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-fe48a748-c255-4277-8163-8ea5a65d0fb5 req-b81569ac-e5fa-409b-86ac-65d1e5933c11 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:56.182765 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.compute.server_external_events [req-fe48a748-c255-4277-8163-8ea5a65d0fb5 req-b81569ac-e5fa-409b-86ac-65d1e5933c11 service nova] Creating event network-vif-deleted:e9364631-16e8-4942-9d25-6d57b908924e for instance 24238b06-aad3-47d2-ad13-a91926a0634d on hv-cinder-85221 Sep 01 14:15:56.188521 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [req-fe48a748-c255-4277-8163-8ea5a65d0fb5 req-b81569ac-e5fa-409b-86ac-65d1e5933c11 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070127 Sep 01 14:15:56.189695 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 560/1126] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:15:56.367683 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-f112d688-2f6b-4cdb-babd-3fc0f44d1dcb tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:15:56.369067 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-f112d688-2f6b-4cdb-babd-3fc0f44d1dcb tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] [instance: 24238b06-aad3-47d2-ad13-a91926a0634d] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:15:56.376965 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f112d688-2f6b-4cdb-babd-3fc0f44d1dcb tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:56.377527 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f112d688-2f6b-4cdb-babd-3fc0f44d1dcb tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:56.377976 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f112d688-2f6b-4cdb-babd-3fc0f44d1dcb tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:56.378792 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f112d688-2f6b-4cdb-babd-3fc0f44d1dcb tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:56.379277 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f112d688-2f6b-4cdb-babd-3fc0f44d1dcb tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:56.379709 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f112d688-2f6b-4cdb-babd-3fc0f44d1dcb tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:56.455464 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-f112d688-2f6b-4cdb-babd-3fc0f44d1dcb tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176ac62de5974fef91b59293df718ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493732d3c282440f8593558858bb0b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:15:56.470102 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-f112d688-2f6b-4cdb-babd-3fc0f44d1dcb tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] 10.222.0.25 "GET /compute/v2.1/servers/24238b06-aad3-47d2-ad13-a91926a0634d" status: 200 len: 1299 microversion: 2.1 time: 0.106430 Sep 01 14:15:56.470743 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 567/1127] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:15:56 2022] GET /compute/v2.1/servers/24238b06-aad3-47d2-ad13-a91926a0634d => generated 1299 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:15:57.494116 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-e2985f8b-1e15-4315-b6c7-aaa6e1f44e5a tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:15:57.495463 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-e2985f8b-1e15-4315-b6c7-aaa6e1f44e5a tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] [instance: 24238b06-aad3-47d2-ad13-a91926a0634d] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:15:57.515575 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e2985f8b-1e15-4315-b6c7-aaa6e1f44e5a tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:57.516831 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e2985f8b-1e15-4315-b6c7-aaa6e1f44e5a tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:57.517520 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e2985f8b-1e15-4315-b6c7-aaa6e1f44e5a tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:57.518977 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e2985f8b-1e15-4315-b6c7-aaa6e1f44e5a tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:57.519445 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e2985f8b-1e15-4315-b6c7-aaa6e1f44e5a tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:57.520072 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e2985f8b-1e15-4315-b6c7-aaa6e1f44e5a tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:57.547213 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.wsgi [None req-e2985f8b-1e15-4315-b6c7-aaa6e1f44e5a tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] HTTP exception thrown: Instance 24238b06-aad3-47d2-ad13-a91926a0634d could not be found. Sep 01 14:15:57.550930 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-e2985f8b-1e15-4315-b6c7-aaa6e1f44e5a tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Request method failure captured: Sep 01 14:15:57.550930 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: request: GET /compute/v2.1/servers/24238b06-aad3-47d2-ad13-a91926a0634d HTTP/1.1 Sep 01 14:15:57.550930 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept: application/json Sep 01 14:15:57.550930 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept-Encoding: identity Sep 01 14:15:57.550930 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Connection: close Sep 01 14:15:57.550930 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Length: 0 Sep 01 14:15:57.550930 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Type: application/json Sep 01 14:15:57.550930 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Host: 10.222.0.25 Sep 01 14:15:57.550930 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Openstack-System-Scope: None Sep 01 14:15:57.550930 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: User-Agent: python-urllib3/1.26.12 Sep 01 14:15:57.550930 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Auth-Token: gAAAAABjEL6CcG7DwwphPpZr4EmHIOrI1oLwEmxuHdwntgW9Ntsn0ifzcnW52pQprgaGrqloy9ajbZu5EKKsuLCDT2XQx-z5KAuvdSLuuzH3Oau8jdqE7CnnLtDnw3TufzqLP-iW8VaUrkbesPseLV5UtPZql0GxmhUrZz-nT2I80X4rCXljh1g Sep 01 14:15:57.550930 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Id: None Sep 01 14:15:57.550930 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Name: None Sep 01 14:15:57.550930 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Identity-Status: Confirmed Sep 01 14:15:57.550930 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Is-Admin-Project: True Sep 01 14:15:57.550930 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Id: default Sep 01 14:15:57.550930 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Name: Default Sep 01 14:15:57.550930 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Id: 493732d3c282440f8593558858bb0b33 Sep 01 14:15:57.550930 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Name: tempest-VolumesActionsTest-167410230 Sep 01 14:15:57.550930 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Role: member,reader Sep 01 14:15:57.550930 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Roles: member,reader Sep 01 14:15:57.553051 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/493732d3c282440f8593558858bb0b33"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/493732d3c282440f8593558858bb0b33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/493732d3c282440f8593558858bb0b33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_493732d3c282440f8593558858bb0b33"}]}] Sep 01 14:15:57.553051 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant: tempest-VolumesActionsTest-167410230 Sep 01 14:15:57.553051 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Id: 493732d3c282440f8593558858bb0b33 Sep 01 14:15:57.553051 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Name: tempest-VolumesActionsTest-167410230 Sep 01 14:15:57.553051 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User: tempest-VolumesActionsTest-167410230-project Sep 01 14:15:57.553051 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Id: default Sep 01 14:15:57.553051 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Name: Default Sep 01 14:15:57.553051 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Id: 176ac62de5974fef91b59293df718ebc Sep 01 14:15:57.553051 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Name: tempest-VolumesActionsTest-167410230-project Sep 01 14:15:57.553051 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: method: > Sep 01 14:15:57.553051 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: exception: Instance 24238b06-aad3-47d2-ad13-a91926a0634d could not be found. Sep 01 14:15:57.553051 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: action_args: {'id': '24238b06-aad3-47d2-ad13-a91926a0634d'} Sep 01 14:15:57.554132 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:15:57.554132 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:57.554132 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:15:57.554132 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:15:57.554132 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:15:57.554132 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:15:57.554132 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:15:57.554132 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:15:57.554132 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:15:57.554132 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:15:57.554132 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24238b06-aad3-47d2-ad13-a91926a0634d could not be found. Sep 01 14:15:57.554132 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:15:57.554132 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:15:57.554132 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:15:57.554132 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:57.554132 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:15:57.554132 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:15:57.554132 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:15:57.554132 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:15:57.554132 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:15:57.567134 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:15:57.567134 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:15:57.567134 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:15:57.567134 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:15:57.567134 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:15:57.567134 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:15:57.567134 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:15:57.567134 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24238b06-aad3-47d2-ad13-a91926a0634d could not be found. Sep 01 14:15:57.567134 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:15:57.567134 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:15:57.567134 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:15:57.567134 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:57.567134 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:15:57.567134 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:15:57.567134 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:15:57.567134 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:15:57.567134 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24238b06-aad3-47d2-ad13-a91926a0634d could not be found. Sep 01 14:15:57.567134 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:15:57.568666 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-e2985f8b-1e15-4315-b6c7-aaa6e1f44e5a tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Returning 404 to user: Instance 24238b06-aad3-47d2-ad13-a91926a0634d could not be found. {{(pid=121339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:15:57.568666 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-e2985f8b-1e15-4315-b6c7-aaa6e1f44e5a tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] 10.222.0.25 "GET /compute/v2.1/servers/24238b06-aad3-47d2-ad13-a91926a0634d" status: 404 len: 111 microversion: 2.1 time: 0.065606 Sep 01 14:15:57.568666 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 561/1128] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:15:57 2022] GET /compute/v2.1/servers/24238b06-aad3-47d2-ad13-a91926a0634d => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:15:57.714021 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-b3f4f7ae-f9b3-4b60-8d5f-b0200c1c3789 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2046646888", "imageRef": "9be77128-e763-4225-b76f-85fbb04ad9b2", "flavorRef": "452", "networks": [{"uuid": "b4e12ec0-72a1-4de6-85a2-65af038c9b2d"}]}} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:15:57.785872 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.network.neutron [None req-b3f4f7ae-f9b3-4b60-8d5f-b0200c1c3789 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] validate_networks() for [('b4e12ec0-72a1-4de6-85a2-65af038c9b2d', None, None, None, None, None)] {{(pid=121340) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:15:58.232986 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-b3f4f7ae-f9b3-4b60-8d5f-b0200c1c3789 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Flavor limits 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:15:58.233395 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-b3f4f7ae-f9b3-4b60-8d5f-b0200c1c3789 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Image limits 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:15:58.234085 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-b3f4f7ae-f9b3-4b60-8d5f-b0200c1c3789 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Flavor pref 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:15:58.234493 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-b3f4f7ae-f9b3-4b60-8d5f-b0200c1c3789 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Image pref 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:15:58.234906 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-b3f4f7ae-f9b3-4b60-8d5f-b0200c1c3789 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:15:58.245184 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b3f4f7ae-f9b3-4b60-8d5f-b0200c1c3789 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:58.245665 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b3f4f7ae-f9b3-4b60-8d5f-b0200c1c3789 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:58.246165 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b3f4f7ae-f9b3-4b60-8d5f-b0200c1c3789 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:58.246990 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b3f4f7ae-f9b3-4b60-8d5f-b0200c1c3789 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:58.247657 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b3f4f7ae-f9b3-4b60-8d5f-b0200c1c3789 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:58.248265 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b3f4f7ae-f9b3-4b60-8d5f-b0200c1c3789 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:58.267981 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.quota [None req-b3f4f7ae-f9b3-4b60-8d5f-b0200c1c3789 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Getting quotas for project 493732d3c282440f8593558858bb0b33. Resources: {'cores', 'instances', 'ram'} {{(pid=121340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:15:58.272899 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.quota [None req-b3f4f7ae-f9b3-4b60-8d5f-b0200c1c3789 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Getting quotas for user 176ac62de5974fef91b59293df718ebc and project 493732d3c282440f8593558858bb0b33. Resources: {'cores', 'instances', 'ram'} {{(pid=121340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:15:58.286774 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-b3f4f7ae-f9b3-4b60-8d5f-b0200c1c3789 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Going to run 1 instances... {{(pid=121340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:15:58.289107 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-b3f4f7ae-f9b3-4b60-8d5f-b0200c1c3789 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] [instance: 2ffa4508-48a9-4498-9e28-3d7c609fa06e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9be77128-e763-4225-b76f-85fbb04ad9b2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:15:58.443815 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-b3f4f7ae-f9b3-4b60-8d5f-b0200c1c3789 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.736176 Sep 01 14:15:58.455111 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 568/1129] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 1 14:15:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 14:15:58.465691 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-f6c616c0-1cac-425e-b19f-ad86bceee445 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:15:58.466873 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-f6c616c0-1cac-425e-b19f-ad86bceee445 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] [instance: 2ffa4508-48a9-4498-9e28-3d7c609fa06e] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:15:58.539940 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-f6c616c0-1cac-425e-b19f-ad86bceee445 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176ac62de5974fef91b59293df718ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493732d3c282440f8593558858bb0b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:15:58.556247 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-f6c616c0-1cac-425e-b19f-ad86bceee445 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] 10.222.0.25 "GET /compute/v2.1/servers/2ffa4508-48a9-4498-9e28-3d7c609fa06e" status: 200 len: 1214 microversion: 2.1 time: 0.097851 Sep 01 14:15:58.559214 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 562/1130] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:15:58 2022] GET /compute/v2.1/servers/2ffa4508-48a9-4498-9e28-3d7c609fa06e => generated 1214 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:15:59.600759 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-09844f1a-81ba-4fc5-afff-9ee8c70c8e3a tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:15:59.601480 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-09844f1a-81ba-4fc5-afff-9ee8c70c8e3a tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] [instance: 2ffa4508-48a9-4498-9e28-3d7c609fa06e] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:15:59.658849 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-09844f1a-81ba-4fc5-afff-9ee8c70c8e3a tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176ac62de5974fef91b59293df718ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493732d3c282440f8593558858bb0b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:15:59.667145 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-09844f1a-81ba-4fc5-afff-9ee8c70c8e3a tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] 10.222.0.25 "GET /compute/v2.1/servers/2ffa4508-48a9-4498-9e28-3d7c609fa06e" status: 200 len: 1214 microversion: 2.1 time: 0.070928 Sep 01 14:15:59.667716 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 569/1131] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:15:59 2022] GET /compute/v2.1/servers/2ffa4508-48a9-4498-9e28-3d7c609fa06e => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:16:00.690520 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-6814268e-3d4b-47f4-af2f-5e0bf3412c10 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:16:00.691716 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-6814268e-3d4b-47f4-af2f-5e0bf3412c10 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] [instance: 2ffa4508-48a9-4498-9e28-3d7c609fa06e] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:16:00.703326 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6814268e-3d4b-47f4-af2f-5e0bf3412c10 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:00.704799 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6814268e-3d4b-47f4-af2f-5e0bf3412c10 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:00.705657 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6814268e-3d4b-47f4-af2f-5e0bf3412c10 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:00.706930 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6814268e-3d4b-47f4-af2f-5e0bf3412c10 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:00.707876 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6814268e-3d4b-47f4-af2f-5e0bf3412c10 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:00.708604 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6814268e-3d4b-47f4-af2f-5e0bf3412c10 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:00.801209 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-6814268e-3d4b-47f4-af2f-5e0bf3412c10 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176ac62de5974fef91b59293df718ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493732d3c282440f8593558858bb0b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:16:00.810651 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-6814268e-3d4b-47f4-af2f-5e0bf3412c10 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] 10.222.0.25 "GET /compute/v2.1/servers/2ffa4508-48a9-4498-9e28-3d7c609fa06e" status: 200 len: 1210 microversion: 2.1 time: 0.125652 Sep 01 14:16:00.811232 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 563/1132] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:16:00 2022] GET /compute/v2.1/servers/2ffa4508-48a9-4498-9e28-3d7c609fa06e => generated 1210 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:16:01.841420 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-ad2c2a72-0daa-46ff-be39-b679d6cbac3e tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:16:01.841420 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-ad2c2a72-0daa-46ff-be39-b679d6cbac3e tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] [instance: 2ffa4508-48a9-4498-9e28-3d7c609fa06e] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:16:01.848662 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ad2c2a72-0daa-46ff-be39-b679d6cbac3e tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:01.849131 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ad2c2a72-0daa-46ff-be39-b679d6cbac3e tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:01.849572 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ad2c2a72-0daa-46ff-be39-b679d6cbac3e tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:01.850308 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ad2c2a72-0daa-46ff-be39-b679d6cbac3e tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:01.850830 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ad2c2a72-0daa-46ff-be39-b679d6cbac3e tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:01.851478 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ad2c2a72-0daa-46ff-be39-b679d6cbac3e tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:01.934065 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-ad2c2a72-0daa-46ff-be39-b679d6cbac3e tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176ac62de5974fef91b59293df718ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493732d3c282440f8593558858bb0b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:16:01.949579 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-ad2c2a72-0daa-46ff-be39-b679d6cbac3e tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] 10.222.0.25 "GET /compute/v2.1/servers/2ffa4508-48a9-4498-9e28-3d7c609fa06e" status: 200 len: 1274 microversion: 2.1 time: 0.114520 Sep 01 14:16:01.950210 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 570/1133] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:16:01 2022] GET /compute/v2.1/servers/2ffa4508-48a9-4498-9e28-3d7c609fa06e => generated 1274 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:16:02.976878 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-de9de6d6-00ed-40ce-a76a-f627eede36a3 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:16:02.977832 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-de9de6d6-00ed-40ce-a76a-f627eede36a3 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] [instance: 2ffa4508-48a9-4498-9e28-3d7c609fa06e] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:16:02.999787 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-de9de6d6-00ed-40ce-a76a-f627eede36a3 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:03.000698 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-de9de6d6-00ed-40ce-a76a-f627eede36a3 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:03.001353 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-de9de6d6-00ed-40ce-a76a-f627eede36a3 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:03.004364 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-de9de6d6-00ed-40ce-a76a-f627eede36a3 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:03.005087 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-de9de6d6-00ed-40ce-a76a-f627eede36a3 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:03.005767 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-de9de6d6-00ed-40ce-a76a-f627eede36a3 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:03.202583 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-de9de6d6-00ed-40ce-a76a-f627eede36a3 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176ac62de5974fef91b59293df718ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493732d3c282440f8593558858bb0b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:16:03.218726 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-de9de6d6-00ed-40ce-a76a-f627eede36a3 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] 10.222.0.25 "GET /compute/v2.1/servers/2ffa4508-48a9-4498-9e28-3d7c609fa06e" status: 200 len: 1314 microversion: 2.1 time: 0.247200 Sep 01 14:16:03.219503 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 564/1134] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:16:02 2022] GET /compute/v2.1/servers/2ffa4508-48a9-4498-9e28-3d7c609fa06e => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:16:04.261766 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-0f3b6bf8-bb34-44c5-bc7f-7e7e10f90975 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:16:04.262911 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-0f3b6bf8-bb34-44c5-bc7f-7e7e10f90975 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] [instance: 2ffa4508-48a9-4498-9e28-3d7c609fa06e] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:16:04.265437 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:04.270685 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0f3b6bf8-bb34-44c5-bc7f-7e7e10f90975 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:04.271166 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0f3b6bf8-bb34-44c5-bc7f-7e7e10f90975 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:04.271598 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0f3b6bf8-bb34-44c5-bc7f-7e7e10f90975 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:04.272306 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0f3b6bf8-bb34-44c5-bc7f-7e7e10f90975 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:04.272759 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0f3b6bf8-bb34-44c5-bc7f-7e7e10f90975 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:04.273181 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0f3b6bf8-bb34-44c5-bc7f-7e7e10f90975 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:04.276955 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:04.380665 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [req-2c7a4771-4bdb-4794-96fc-4d68e8d1804d req-0a0bfe3d-98df-472f-9a6e-4cac1a45523f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ffa4508-48a9-4498-9e28-3d7c609fa06e", "tag": "856de7b8-7854-4ca0-acdf-ffafb624a088"}]} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:16:04.398488 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-2c7a4771-4bdb-4794-96fc-4d68e8d1804d req-0a0bfe3d-98df-472f-9a6e-4cac1a45523f service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:04.399618 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-2c7a4771-4bdb-4794-96fc-4d68e8d1804d req-0a0bfe3d-98df-472f-9a6e-4cac1a45523f service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:04.400115 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-2c7a4771-4bdb-4794-96fc-4d68e8d1804d req-0a0bfe3d-98df-472f-9a6e-4cac1a45523f service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:04.413429 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.compute.server_external_events [req-2c7a4771-4bdb-4794-96fc-4d68e8d1804d req-0a0bfe3d-98df-472f-9a6e-4cac1a45523f service nova] Creating event network-changed:856de7b8-7854-4ca0-acdf-ffafb624a088 for instance 2ffa4508-48a9-4498-9e28-3d7c609fa06e on hv-cinder-85221 Sep 01 14:16:04.420563 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [req-2c7a4771-4bdb-4794-96fc-4d68e8d1804d req-0a0bfe3d-98df-472f-9a6e-4cac1a45523f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051894 Sep 01 14:16:04.424563 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 565/1135] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:16:04.495879 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-0f3b6bf8-bb34-44c5-bc7f-7e7e10f90975 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176ac62de5974fef91b59293df718ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493732d3c282440f8593558858bb0b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:16:04.505490 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-0f3b6bf8-bb34-44c5-bc7f-7e7e10f90975 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] 10.222.0.25 "GET /compute/v2.1/servers/2ffa4508-48a9-4498-9e28-3d7c609fa06e" status: 200 len: 1314 microversion: 2.1 time: 0.249393 Sep 01 14:16:04.506428 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 571/1136] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:16:04 2022] GET /compute/v2.1/servers/2ffa4508-48a9-4498-9e28-3d7c609fa06e => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:16:05.530487 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-f7355ea9-ea4b-4b77-bceb-773a2e8876c2 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:16:05.531299 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-f7355ea9-ea4b-4b77-bceb-773a2e8876c2 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] [instance: 2ffa4508-48a9-4498-9e28-3d7c609fa06e] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:16:05.538535 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f7355ea9-ea4b-4b77-bceb-773a2e8876c2 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:05.539024 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f7355ea9-ea4b-4b77-bceb-773a2e8876c2 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:05.540156 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f7355ea9-ea4b-4b77-bceb-773a2e8876c2 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:05.541221 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f7355ea9-ea4b-4b77-bceb-773a2e8876c2 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:05.541742 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f7355ea9-ea4b-4b77-bceb-773a2e8876c2 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:05.542198 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f7355ea9-ea4b-4b77-bceb-773a2e8876c2 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:05.716621 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-f7355ea9-ea4b-4b77-bceb-773a2e8876c2 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176ac62de5974fef91b59293df718ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493732d3c282440f8593558858bb0b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:16:05.724958 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-f7355ea9-ea4b-4b77-bceb-773a2e8876c2 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] 10.222.0.25 "GET /compute/v2.1/servers/2ffa4508-48a9-4498-9e28-3d7c609fa06e" status: 200 len: 1314 microversion: 2.1 time: 0.201006 Sep 01 14:16:05.725567 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 566/1137] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:16:05 2022] GET /compute/v2.1/servers/2ffa4508-48a9-4498-9e28-3d7c609fa06e => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:16:05.968925 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-e9fe6063-9e49-4599-8801-a2a4bb4d6fa8 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:16:05.969879 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-e9fe6063-9e49-4599-8801-a2a4bb4d6fa8 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: e221a685-4333-48cb-ab94-67a4c0402490] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:16:05.983515 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e9fe6063-9e49-4599-8801-a2a4bb4d6fa8 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:05.984016 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e9fe6063-9e49-4599-8801-a2a4bb4d6fa8 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:05.984512 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e9fe6063-9e49-4599-8801-a2a4bb4d6fa8 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:05.985380 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e9fe6063-9e49-4599-8801-a2a4bb4d6fa8 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:05.986210 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e9fe6063-9e49-4599-8801-a2a4bb4d6fa8 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:05.986981 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e9fe6063-9e49-4599-8801-a2a4bb4d6fa8 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:06.020401 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-e9fe6063-9e49-4599-8801-a2a4bb4d6fa8 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: e221a685-4333-48cb-ab94-67a4c0402490] Going to try to terminate instance {{(pid=121340) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:16:06.429194 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-e9fe6063-9e49-4599-8801-a2a4bb4d6fa8 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490" status: 204 len: 0 microversion: 2.1 time: 0.467765 Sep 01 14:16:06.430879 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 572/1138] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 14:16:05 2022] DELETE /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:16:06.439903 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-df77c57f-d1ab-4830-89d3-cad15fe692cb tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:16:06.440662 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-df77c57f-d1ab-4830-89d3-cad15fe692cb tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: e221a685-4333-48cb-ab94-67a4c0402490] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:16:06.448540 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-df77c57f-d1ab-4830-89d3-cad15fe692cb tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:06.449175 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-df77c57f-d1ab-4830-89d3-cad15fe692cb tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:06.449711 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-df77c57f-d1ab-4830-89d3-cad15fe692cb tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:06.450556 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-df77c57f-d1ab-4830-89d3-cad15fe692cb tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:06.451111 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-df77c57f-d1ab-4830-89d3-cad15fe692cb tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:06.451633 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-df77c57f-d1ab-4830-89d3-cad15fe692cb tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:06.635177 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-df77c57f-d1ab-4830-89d3-cad15fe692cb tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:16:06.643581 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-df77c57f-d1ab-4830-89d3-cad15fe692cb tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490" status: 200 len: 1578 microversion: 2.1 time: 0.207956 Sep 01 14:16:06.644175 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 567/1139] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:16:06 2022] GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490 => generated 1578 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:16:06.747758 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-f33ed15d-fb63-4a9e-9341-b0fa6808eae3 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:16:06.748628 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-f33ed15d-fb63-4a9e-9341-b0fa6808eae3 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] [instance: 2ffa4508-48a9-4498-9e28-3d7c609fa06e] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:16:06.755287 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f33ed15d-fb63-4a9e-9341-b0fa6808eae3 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:06.755876 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f33ed15d-fb63-4a9e-9341-b0fa6808eae3 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:06.756318 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f33ed15d-fb63-4a9e-9341-b0fa6808eae3 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:06.757052 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f33ed15d-fb63-4a9e-9341-b0fa6808eae3 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:06.757503 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f33ed15d-fb63-4a9e-9341-b0fa6808eae3 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:06.757947 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f33ed15d-fb63-4a9e-9341-b0fa6808eae3 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:06.913515 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-f33ed15d-fb63-4a9e-9341-b0fa6808eae3 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176ac62de5974fef91b59293df718ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493732d3c282440f8593558858bb0b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:16:06.923003 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-f33ed15d-fb63-4a9e-9341-b0fa6808eae3 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] 10.222.0.25 "GET /compute/v2.1/servers/2ffa4508-48a9-4498-9e28-3d7c609fa06e" status: 200 len: 1314 microversion: 2.1 time: 0.180519 Sep 01 14:16:06.923713 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 573/1140] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:16:06 2022] GET /compute/v2.1/servers/2ffa4508-48a9-4498-9e28-3d7c609fa06e => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:16:07.666301 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-fb910b94-5b5c-49ca-a781-baffd0628650 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:16:07.667031 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-fb910b94-5b5c-49ca-a781-baffd0628650 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: e221a685-4333-48cb-ab94-67a4c0402490] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:16:07.674290 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fb910b94-5b5c-49ca-a781-baffd0628650 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:07.674800 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fb910b94-5b5c-49ca-a781-baffd0628650 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:07.675241 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fb910b94-5b5c-49ca-a781-baffd0628650 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:07.675996 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fb910b94-5b5c-49ca-a781-baffd0628650 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:07.676460 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fb910b94-5b5c-49ca-a781-baffd0628650 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:07.676894 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fb910b94-5b5c-49ca-a781-baffd0628650 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:07.847272 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-fb910b94-5b5c-49ca-a781-baffd0628650 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:16:07.861007 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-fb910b94-5b5c-49ca-a781-baffd0628650 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490" status: 200 len: 1578 microversion: 2.1 time: 0.199141 Sep 01 14:16:07.862111 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 568/1141] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:16:07 2022] GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490 => generated 1578 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:16:07.947214 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-ea26ff4f-6228-4c06-b2b8-684b98cfa7c6 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:16:07.954715 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-ea26ff4f-6228-4c06-b2b8-684b98cfa7c6 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] [instance: 2ffa4508-48a9-4498-9e28-3d7c609fa06e] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:16:07.956603 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ea26ff4f-6228-4c06-b2b8-684b98cfa7c6 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:07.957340 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ea26ff4f-6228-4c06-b2b8-684b98cfa7c6 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:07.958118 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ea26ff4f-6228-4c06-b2b8-684b98cfa7c6 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:07.959382 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ea26ff4f-6228-4c06-b2b8-684b98cfa7c6 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:07.960205 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ea26ff4f-6228-4c06-b2b8-684b98cfa7c6 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:07.960848 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ea26ff4f-6228-4c06-b2b8-684b98cfa7c6 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:08.124966 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-ea26ff4f-6228-4c06-b2b8-684b98cfa7c6 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176ac62de5974fef91b59293df718ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493732d3c282440f8593558858bb0b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:16:08.133805 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-ea26ff4f-6228-4c06-b2b8-684b98cfa7c6 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] 10.222.0.25 "GET /compute/v2.1/servers/2ffa4508-48a9-4498-9e28-3d7c609fa06e" status: 200 len: 1314 microversion: 2.1 time: 0.192137 Sep 01 14:16:08.134436 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 574/1142] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:16:07 2022] GET /compute/v2.1/servers/2ffa4508-48a9-4498-9e28-3d7c609fa06e => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:16:08.895372 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-9eeca863-67e0-4ac7-bdc9-d7584abb7147 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:16:08.896202 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-9eeca863-67e0-4ac7-bdc9-d7584abb7147 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: e221a685-4333-48cb-ab94-67a4c0402490] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:16:08.898363 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell0:SELECT=2 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:08.909329 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9eeca863-67e0-4ac7-bdc9-d7584abb7147 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:08.910582 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9eeca863-67e0-4ac7-bdc9-d7584abb7147 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:08.912091 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9eeca863-67e0-4ac7-bdc9-d7584abb7147 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:08.914036 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9eeca863-67e0-4ac7-bdc9-d7584abb7147 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:08.916068 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9eeca863-67e0-4ac7-bdc9-d7584abb7147 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:08.917355 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9eeca863-67e0-4ac7-bdc9-d7584abb7147 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:09.045628 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-9eeca863-67e0-4ac7-bdc9-d7584abb7147 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:16:09.054984 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-9eeca863-67e0-4ac7-bdc9-d7584abb7147 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490" status: 200 len: 1511 microversion: 2.1 time: 0.163397 Sep 01 14:16:09.056408 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 569/1143] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:16:08 2022] GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490 => generated 1511 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:16:09.173338 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-565137ea-ce56-4d85-8508-c89526a2d1a5 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:16:09.174460 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-565137ea-ce56-4d85-8508-c89526a2d1a5 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] [instance: 2ffa4508-48a9-4498-9e28-3d7c609fa06e] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:16:09.177852 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell0:SELECT=2 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:09.187221 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-565137ea-ce56-4d85-8508-c89526a2d1a5 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:09.193389 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-565137ea-ce56-4d85-8508-c89526a2d1a5 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:09.193389 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-565137ea-ce56-4d85-8508-c89526a2d1a5 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:09.193389 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-565137ea-ce56-4d85-8508-c89526a2d1a5 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:09.193389 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-565137ea-ce56-4d85-8508-c89526a2d1a5 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:09.193821 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-565137ea-ce56-4d85-8508-c89526a2d1a5 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:09.363575 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [req-f8d3c4ea-f24c-4592-9acb-6e79ca3a4788 req-00e81ab7-3f29-416a-abe4-89aa203720e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e221a685-4333-48cb-ab94-67a4c0402490", "name": "network-vif-deleted", "tag": "96452891-5521-419c-9c6f-b16dbf8fef1e"}]} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:16:09.382185 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-f8d3c4ea-f24c-4592-9acb-6e79ca3a4788 req-00e81ab7-3f29-416a-abe4-89aa203720e2 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:09.384370 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-f8d3c4ea-f24c-4592-9acb-6e79ca3a4788 req-00e81ab7-3f29-416a-abe4-89aa203720e2 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:09.385125 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-f8d3c4ea-f24c-4592-9acb-6e79ca3a4788 req-00e81ab7-3f29-416a-abe4-89aa203720e2 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:09.386508 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-565137ea-ce56-4d85-8508-c89526a2d1a5 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176ac62de5974fef91b59293df718ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493732d3c282440f8593558858bb0b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:16:09.393345 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell1:SELECT=97 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:09.400511 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-565137ea-ce56-4d85-8508-c89526a2d1a5 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] 10.222.0.25 "GET /compute/v2.1/servers/2ffa4508-48a9-4498-9e28-3d7c609fa06e" status: 200 len: 1314 microversion: 2.1 time: 0.234469 Sep 01 14:16:09.401205 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 575/1144] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:16:09 2022] GET /compute/v2.1/servers/2ffa4508-48a9-4498-9e28-3d7c609fa06e => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:16:09.409125 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.compute.server_external_events [req-f8d3c4ea-f24c-4592-9acb-6e79ca3a4788 req-00e81ab7-3f29-416a-abe4-89aa203720e2 service nova] Creating event network-vif-deleted:96452891-5521-419c-9c6f-b16dbf8fef1e for instance e221a685-4333-48cb-ab94-67a4c0402490 on hv-cinder-85221 Sep 01 14:16:09.420683 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [req-f8d3c4ea-f24c-4592-9acb-6e79ca3a4788 req-00e81ab7-3f29-416a-abe4-89aa203720e2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064661 Sep 01 14:16:09.442137 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 570/1145] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:16:10.083226 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-86e4ce05-8f9f-42c5-ab4f-40c3d839d681 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:16:10.084278 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-86e4ce05-8f9f-42c5-ab4f-40c3d839d681 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: e221a685-4333-48cb-ab94-67a4c0402490] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:16:10.087875 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell0:SELECT=8 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:10.094034 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-86e4ce05-8f9f-42c5-ab4f-40c3d839d681 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:10.094784 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-86e4ce05-8f9f-42c5-ab4f-40c3d839d681 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:10.095404 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-86e4ce05-8f9f-42c5-ab4f-40c3d839d681 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:10.096308 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-86e4ce05-8f9f-42c5-ab4f-40c3d839d681 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:10.096824 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-86e4ce05-8f9f-42c5-ab4f-40c3d839d681 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:10.097317 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-86e4ce05-8f9f-42c5-ab4f-40c3d839d681 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:10.213792 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-86e4ce05-8f9f-42c5-ab4f-40c3d839d681 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:16:10.230786 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-86e4ce05-8f9f-42c5-ab4f-40c3d839d681 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490" status: 200 len: 1226 microversion: 2.1 time: 0.154919 Sep 01 14:16:10.233519 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 576/1146] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:16:10 2022] GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490 => generated 1226 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:16:10.426953 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-90d16aae-6637-4ef7-8c57-cde3dae437eb tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:16:10.428204 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-90d16aae-6637-4ef7-8c57-cde3dae437eb tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] [instance: 2ffa4508-48a9-4498-9e28-3d7c609fa06e] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:16:10.432944 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_api:SELECT=47 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:10.440547 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-90d16aae-6637-4ef7-8c57-cde3dae437eb tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:10.441276 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-90d16aae-6637-4ef7-8c57-cde3dae437eb tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:10.441868 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-90d16aae-6637-4ef7-8c57-cde3dae437eb tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:10.442986 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-90d16aae-6637-4ef7-8c57-cde3dae437eb tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:10.443835 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-90d16aae-6637-4ef7-8c57-cde3dae437eb tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:10.444813 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-90d16aae-6637-4ef7-8c57-cde3dae437eb tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:10.670863 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-90d16aae-6637-4ef7-8c57-cde3dae437eb tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176ac62de5974fef91b59293df718ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493732d3c282440f8593558858bb0b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:16:10.684087 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-90d16aae-6637-4ef7-8c57-cde3dae437eb tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] 10.222.0.25 "GET /compute/v2.1/servers/2ffa4508-48a9-4498-9e28-3d7c609fa06e" status: 200 len: 1314 microversion: 2.1 time: 0.262950 Sep 01 14:16:10.685118 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 571/1147] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:16:10 2022] GET /compute/v2.1/servers/2ffa4508-48a9-4498-9e28-3d7c609fa06e => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:16:10.734296 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [req-fcc8e3e8-3572-45d8-a333-e4cf9911992c req-b921ba8a-6884-4da9-9473-79b9576be286 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ffa4508-48a9-4498-9e28-3d7c609fa06e", "name": "network-vif-plugged", "status": "completed", "tag": "856de7b8-7854-4ca0-acdf-ffafb624a088"}]} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:16:10.754464 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-fcc8e3e8-3572-45d8-a333-e4cf9911992c req-b921ba8a-6884-4da9-9473-79b9576be286 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:10.758996 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-fcc8e3e8-3572-45d8-a333-e4cf9911992c req-b921ba8a-6884-4da9-9473-79b9576be286 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:10.758996 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-fcc8e3e8-3572-45d8-a333-e4cf9911992c req-b921ba8a-6884-4da9-9473-79b9576be286 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:10.783482 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.compute.server_external_events [req-fcc8e3e8-3572-45d8-a333-e4cf9911992c req-b921ba8a-6884-4da9-9473-79b9576be286 service nova] Creating event network-vif-plugged:856de7b8-7854-4ca0-acdf-ffafb624a088 for instance 2ffa4508-48a9-4498-9e28-3d7c609fa06e on hv-cinder-85221 Sep 01 14:16:10.793490 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [req-fcc8e3e8-3572-45d8-a333-e4cf9911992c req-b921ba8a-6884-4da9-9473-79b9576be286 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068707 Sep 01 14:16:10.794562 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 577/1148] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:16:11.266379 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-8695c64b-6c6c-47df-a977-1640acafbf24 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:16:11.267275 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-8695c64b-6c6c-47df-a977-1640acafbf24 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: e221a685-4333-48cb-ab94-67a4c0402490] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:16:11.275366 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8695c64b-6c6c-47df-a977-1640acafbf24 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:11.275876 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8695c64b-6c6c-47df-a977-1640acafbf24 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:11.276326 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8695c64b-6c6c-47df-a977-1640acafbf24 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:11.277063 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8695c64b-6c6c-47df-a977-1640acafbf24 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:11.277534 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8695c64b-6c6c-47df-a977-1640acafbf24 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:11.278021 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-8695c64b-6c6c-47df-a977-1640acafbf24 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:11.295773 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.wsgi [None req-8695c64b-6c6c-47df-a977-1640acafbf24 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] HTTP exception thrown: Instance e221a685-4333-48cb-ab94-67a4c0402490 could not be found. Sep 01 14:16:11.297486 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-8695c64b-6c6c-47df-a977-1640acafbf24 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Request method failure captured: Sep 01 14:16:11.297486 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: request: GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490 HTTP/1.1 Sep 01 14:16:11.297486 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept: application/json Sep 01 14:16:11.297486 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept-Encoding: identity Sep 01 14:16:11.297486 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Connection: close Sep 01 14:16:11.297486 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Length: 0 Sep 01 14:16:11.297486 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Type: application/json Sep 01 14:16:11.297486 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Host: 10.222.0.25 Sep 01 14:16:11.297486 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Openstack-System-Scope: None Sep 01 14:16:11.297486 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: User-Agent: python-urllib3/1.26.12 Sep 01 14:16:11.297486 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Auth-Token: gAAAAABjEL3NOrxJYijbJSOMZMLZzZSVPHyAdl_Bm2Q9EKvB6aWvFJhgq4XisE3tQ1CJ0eLS1f3ZaMz1-2KlOZ5qeLsAV5fmAZJmiV4-9A-IotFZOfK4CGwgPA9xha4GJ_b5LDPIkmmB5fUTtMCqvypE0Q1RYsFekKspBEpjT9EUqbzEyw-7SOw Sep 01 14:16:11.297486 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Id: None Sep 01 14:16:11.297486 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Name: None Sep 01 14:16:11.297486 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Identity-Status: Confirmed Sep 01 14:16:11.297486 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Is-Admin-Project: True Sep 01 14:16:11.297486 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Id: default Sep 01 14:16:11.297486 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Name: Default Sep 01 14:16:11.297486 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Id: 8acdb976501045c0813d16f3d0ffd13d Sep 01 14:16:11.297486 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Name: tempest-TestVolumeBootPattern-657955642 Sep 01 14:16:11.297486 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Role: member,reader Sep 01 14:16:11.297486 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Roles: member,reader Sep 01 14:16:11.300603 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8acdb976501045c0813d16f3d0ffd13d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8acdb976501045c0813d16f3d0ffd13d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8acdb976501045c0813d16f3d0ffd13d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8acdb976501045c0813d16f3d0ffd13d"}]}] Sep 01 14:16:11.300603 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant: tempest-TestVolumeBootPattern-657955642 Sep 01 14:16:11.300603 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Id: 8acdb976501045c0813d16f3d0ffd13d Sep 01 14:16:11.300603 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Name: tempest-TestVolumeBootPattern-657955642 Sep 01 14:16:11.300603 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User: tempest-TestVolumeBootPattern-657955642-project Sep 01 14:16:11.300603 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Id: default Sep 01 14:16:11.300603 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Name: Default Sep 01 14:16:11.300603 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Id: 93f843d15d194f0b9f44ec33c49b9b4c Sep 01 14:16:11.300603 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Name: tempest-TestVolumeBootPattern-657955642-project Sep 01 14:16:11.300603 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: method: > Sep 01 14:16:11.300603 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: exception: Instance e221a685-4333-48cb-ab94-67a4c0402490 could not be found. Sep 01 14:16:11.300603 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: action_args: {'id': 'e221a685-4333-48cb-ab94-67a4c0402490'} Sep 01 14:16:11.302209 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:16:11.302209 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:16:11.302209 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:16:11.302209 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:16:11.302209 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:16:11.302209 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:16:11.302209 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:16:11.302209 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:16:11.302209 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:16:11.302209 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:16:11.302209 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e221a685-4333-48cb-ab94-67a4c0402490 could not be found. Sep 01 14:16:11.302209 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:16:11.302209 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:16:11.302209 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:16:11.302209 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:16:11.302209 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:16:11.302209 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:16:11.302209 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:16:11.302209 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:16:11.302209 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:16:11.304014 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:16:11.304014 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:16:11.304014 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:16:11.304014 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:16:11.304014 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:16:11.304014 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:16:11.304014 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:16:11.304014 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e221a685-4333-48cb-ab94-67a4c0402490 could not be found. Sep 01 14:16:11.304014 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:16:11.304014 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:16:11.304014 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:16:11.304014 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:16:11.304014 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:16:11.304014 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:16:11.304014 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:16:11.304014 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:16:11.304014 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e221a685-4333-48cb-ab94-67a4c0402490 could not be found. Sep 01 14:16:11.304014 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:16:11.306238 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-8695c64b-6c6c-47df-a977-1640acafbf24 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Returning 404 to user: Instance e221a685-4333-48cb-ab94-67a4c0402490 could not be found. {{(pid=121339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:16:11.306238 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-8695c64b-6c6c-47df-a977-1640acafbf24 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490" status: 404 len: 111 microversion: 2.1 time: 0.037912 Sep 01 14:16:11.306238 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 572/1149] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:16:11 2022] GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 14:16:11.417532 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-0aab5fd3-eba6-4197-8243-8a065c9c1ad7 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-595048660", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1695617707", "security_groups": [{"name": "tempest-secgroup-smoke-597656021"}], "block_device_mapping_v2": [{"uuid": "2fee184e-c65e-4451-9214-86803be02b83", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ebd60ad1-5f3d-4543-91a0-ad7aa3eae6b0"}]}} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:16:11.548933 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.network.neutron [None req-0aab5fd3-eba6-4197-8243-8a065c9c1ad7 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] validate_networks() for [('ebd60ad1-5f3d-4543-91a0-ad7aa3eae6b0', None, None, None, None, None)] {{(pid=121340) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:16:11.711588 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-003c1935-7525-404d-94f8-94eced85a2b7 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:16:11.713082 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-003c1935-7525-404d-94f8-94eced85a2b7 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] [instance: 2ffa4508-48a9-4498-9e28-3d7c609fa06e] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:16:11.719541 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-003c1935-7525-404d-94f8-94eced85a2b7 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:11.720042 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-003c1935-7525-404d-94f8-94eced85a2b7 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:11.720487 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-003c1935-7525-404d-94f8-94eced85a2b7 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:11.721300 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-003c1935-7525-404d-94f8-94eced85a2b7 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:11.721770 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-003c1935-7525-404d-94f8-94eced85a2b7 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:11.722233 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-003c1935-7525-404d-94f8-94eced85a2b7 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:11.951382 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-003c1935-7525-404d-94f8-94eced85a2b7 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176ac62de5974fef91b59293df718ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493732d3c282440f8593558858bb0b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:16:11.963542 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-003c1935-7525-404d-94f8-94eced85a2b7 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] 10.222.0.25 "GET /compute/v2.1/servers/2ffa4508-48a9-4498-9e28-3d7c609fa06e" status: 200 len: 1314 microversion: 2.1 time: 0.255851 Sep 01 14:16:11.964438 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 573/1150] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:16:11 2022] GET /compute/v2.1/servers/2ffa4508-48a9-4498-9e28-3d7c609fa06e => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:16:12.057129 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-0aab5fd3-eba6-4197-8243-8a065c9c1ad7 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Flavor limits 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:16:12.057552 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-0aab5fd3-eba6-4197-8243-8a065c9c1ad7 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Image limits 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:16:12.058061 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-0aab5fd3-eba6-4197-8243-8a065c9c1ad7 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Flavor pref 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:16:12.058476 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-0aab5fd3-eba6-4197-8243-8a065c9c1ad7 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Image pref 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:16:12.058917 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-0aab5fd3-eba6-4197-8243-8a065c9c1ad7 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:16:12.068743 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0aab5fd3-eba6-4197-8243-8a065c9c1ad7 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:12.069230 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0aab5fd3-eba6-4197-8243-8a065c9c1ad7 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:12.069679 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0aab5fd3-eba6-4197-8243-8a065c9c1ad7 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:12.070559 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0aab5fd3-eba6-4197-8243-8a065c9c1ad7 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:12.071052 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0aab5fd3-eba6-4197-8243-8a065c9c1ad7 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:12.071487 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0aab5fd3-eba6-4197-8243-8a065c9c1ad7 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:12.091030 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.quota [None req-0aab5fd3-eba6-4197-8243-8a065c9c1ad7 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Getting quotas for project 8acdb976501045c0813d16f3d0ffd13d. Resources: {'cores', 'instances', 'ram'} {{(pid=121340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:16:12.095495 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.quota [None req-0aab5fd3-eba6-4197-8243-8a065c9c1ad7 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Getting quotas for user 93f843d15d194f0b9f44ec33c49b9b4c and project 8acdb976501045c0813d16f3d0ffd13d. Resources: {'cores', 'instances', 'ram'} {{(pid=121340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:16:12.159608 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-0aab5fd3-eba6-4197-8243-8a065c9c1ad7 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Going to run 1 instances... {{(pid=121340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:16:12.161861 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-0aab5fd3-eba6-4197-8243-8a065c9c1ad7 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: da103289-634e-420f-9750-b36e4d00c641] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2fee184e-c65e-4451-9214-86803be02b83',volume_size=None,volume_type=None)] {{(pid=121340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:16:12.743252 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-0aab5fd3-eba6-4197-8243-8a065c9c1ad7 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.331356 Sep 01 14:16:12.744315 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 578/1151] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 1 14:16:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 1333 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 14:16:12.760100 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-5134eff2-44c2-49ae-8896-c85059fa2653 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:16:12.761271 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-5134eff2-44c2-49ae-8896-c85059fa2653 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: da103289-634e-420f-9750-b36e4d00c641] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:16:12.833677 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-5134eff2-44c2-49ae-8896-c85059fa2653 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:16:12.842171 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-5134eff2-44c2-49ae-8896-c85059fa2653 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/da103289-634e-420f-9750-b36e4d00c641" status: 200 len: 1094 microversion: 2.1 time: 0.088415 Sep 01 14:16:12.843010 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 574/1152] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:16:12 2022] GET /compute/v2.1/servers/da103289-634e-420f-9750-b36e4d00c641 => generated 1094 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:16:12.997259 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-2574439a-d568-46e4-ad1f-6689e2379009 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:16:12.998508 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-2574439a-d568-46e4-ad1f-6689e2379009 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] [instance: 2ffa4508-48a9-4498-9e28-3d7c609fa06e] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:16:13.011161 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2574439a-d568-46e4-ad1f-6689e2379009 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:13.011931 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2574439a-d568-46e4-ad1f-6689e2379009 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:13.012568 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2574439a-d568-46e4-ad1f-6689e2379009 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:13.013605 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2574439a-d568-46e4-ad1f-6689e2379009 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:13.014311 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2574439a-d568-46e4-ad1f-6689e2379009 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:13.014856 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-2574439a-d568-46e4-ad1f-6689e2379009 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:13.179599 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-2574439a-d568-46e4-ad1f-6689e2379009 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176ac62de5974fef91b59293df718ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493732d3c282440f8593558858bb0b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:16:13.189223 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-2574439a-d568-46e4-ad1f-6689e2379009 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] 10.222.0.25 "GET /compute/v2.1/servers/2ffa4508-48a9-4498-9e28-3d7c609fa06e" status: 200 len: 1498 microversion: 2.1 time: 0.199785 Sep 01 14:16:13.189823 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 579/1153] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:16:12 2022] GET /compute/v2.1/servers/2ffa4508-48a9-4498-9e28-3d7c609fa06e => generated 1498 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:16:13.866620 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-0deb7414-0254-47b0-aea0-57e5059ad5c3 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:16:13.869045 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-0deb7414-0254-47b0-aea0-57e5059ad5c3 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: da103289-634e-420f-9750-b36e4d00c641] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:16:13.936190 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-0deb7414-0254-47b0-aea0-57e5059ad5c3 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:16:13.949144 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-0deb7414-0254-47b0-aea0-57e5059ad5c3 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/da103289-634e-420f-9750-b36e4d00c641" status: 200 len: 1094 microversion: 2.1 time: 0.086850 Sep 01 14:16:13.951737 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 575/1154] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:16:13 2022] GET /compute/v2.1/servers/da103289-634e-420f-9750-b36e4d00c641 => generated 1094 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:16:14.405062 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-1bf2947b-3dfb-4322-9fb4-366496ae8d54 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:16:14.405747 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-1bf2947b-3dfb-4322-9fb4-366496ae8d54 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] [instance: 2ffa4508-48a9-4498-9e28-3d7c609fa06e] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:16:14.412833 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1bf2947b-3dfb-4322-9fb4-366496ae8d54 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:14.413434 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1bf2947b-3dfb-4322-9fb4-366496ae8d54 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:14.413966 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1bf2947b-3dfb-4322-9fb4-366496ae8d54 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:14.414897 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1bf2947b-3dfb-4322-9fb4-366496ae8d54 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:14.415484 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1bf2947b-3dfb-4322-9fb4-366496ae8d54 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:14.416119 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1bf2947b-3dfb-4322-9fb4-366496ae8d54 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:14.446755 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-1bf2947b-3dfb-4322-9fb4-366496ae8d54 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] [instance: 2ffa4508-48a9-4498-9e28-3d7c609fa06e] Going to try to terminate instance {{(pid=121340) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:16:14.793455 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-1bf2947b-3dfb-4322-9fb4-366496ae8d54 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2ffa4508-48a9-4498-9e28-3d7c609fa06e" status: 204 len: 0 microversion: 2.1 time: 0.392565 Sep 01 14:16:14.794277 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 580/1155] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 14:16:14 2022] DELETE /compute/v2.1/servers/2ffa4508-48a9-4498-9e28-3d7c609fa06e => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:16:14.803454 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-02916d15-5a6b-4c7c-9a71-9b10626840bb tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:16:14.804222 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-02916d15-5a6b-4c7c-9a71-9b10626840bb tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] [instance: 2ffa4508-48a9-4498-9e28-3d7c609fa06e] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:16:14.807362 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 14:16:14.807616 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Thu Sep 1 14:16:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2ffa4508-48a9-4498-9e28-3d7c609fa06e (ip 10.222.0.25) !!! Sep 01 14:16:14.819629 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-02916d15-5a6b-4c7c-9a71-9b10626840bb tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:14.820148 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-02916d15-5a6b-4c7c-9a71-9b10626840bb tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:14.821180 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-02916d15-5a6b-4c7c-9a71-9b10626840bb tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:14.822037 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-02916d15-5a6b-4c7c-9a71-9b10626840bb tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:14.822589 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-02916d15-5a6b-4c7c-9a71-9b10626840bb tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:14.823022 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-02916d15-5a6b-4c7c-9a71-9b10626840bb tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:14.974857 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-ece8bf74-9f6f-4133-b2b4-26f1080151c9 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:16:14.976435 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-ece8bf74-9f6f-4133-b2b4-26f1080151c9 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: da103289-634e-420f-9750-b36e4d00c641] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:16:14.981058 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-02916d15-5a6b-4c7c-9a71-9b10626840bb tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176ac62de5974fef91b59293df718ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493732d3c282440f8593558858bb0b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:16:14.985266 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ece8bf74-9f6f-4133-b2b4-26f1080151c9 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:14.989086 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ece8bf74-9f6f-4133-b2b4-26f1080151c9 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:14.989086 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ece8bf74-9f6f-4133-b2b4-26f1080151c9 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:14.989086 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ece8bf74-9f6f-4133-b2b4-26f1080151c9 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:14.989086 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ece8bf74-9f6f-4133-b2b4-26f1080151c9 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:14.989763 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ece8bf74-9f6f-4133-b2b4-26f1080151c9 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:14.992710 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-02916d15-5a6b-4c7c-9a71-9b10626840bb tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] 10.222.0.25 "GET /compute/v2.1/servers/2ffa4508-48a9-4498-9e28-3d7c609fa06e" status: 200 len: 1504 microversion: 2.1 time: 0.193199 Sep 01 14:16:14.993557 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 576/1156] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:16:14 2022] GET /compute/v2.1/servers/2ffa4508-48a9-4498-9e28-3d7c609fa06e => generated 1504 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:16:15.073460 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-ece8bf74-9f6f-4133-b2b4-26f1080151c9 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:16:15.082485 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-ece8bf74-9f6f-4133-b2b4-26f1080151c9 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/da103289-634e-420f-9750-b36e4d00c641" status: 200 len: 1192 microversion: 2.1 time: 0.112925 Sep 01 14:16:15.083092 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 581/1157] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:16:14 2022] GET /compute/v2.1/servers/da103289-634e-420f-9750-b36e4d00c641 => generated 1192 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:16:16.015026 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-c8f0dec2-05e2-4982-a899-e730eed83112 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:16:16.015842 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-c8f0dec2-05e2-4982-a899-e730eed83112 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] [instance: 2ffa4508-48a9-4498-9e28-3d7c609fa06e] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:16:16.022453 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c8f0dec2-05e2-4982-a899-e730eed83112 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:16.022942 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c8f0dec2-05e2-4982-a899-e730eed83112 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:16.023383 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c8f0dec2-05e2-4982-a899-e730eed83112 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:16.024142 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c8f0dec2-05e2-4982-a899-e730eed83112 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:16.024619 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c8f0dec2-05e2-4982-a899-e730eed83112 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:16.025019 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-c8f0dec2-05e2-4982-a899-e730eed83112 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:16.105644 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-72ce3c8c-01b0-4bb2-a108-d9ac33c2a694 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:16:16.106772 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-72ce3c8c-01b0-4bb2-a108-d9ac33c2a694 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: da103289-634e-420f-9750-b36e4d00c641] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:16:16.115381 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-72ce3c8c-01b0-4bb2-a108-d9ac33c2a694 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:16.116048 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-72ce3c8c-01b0-4bb2-a108-d9ac33c2a694 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:16.116610 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-72ce3c8c-01b0-4bb2-a108-d9ac33c2a694 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:16.118198 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-72ce3c8c-01b0-4bb2-a108-d9ac33c2a694 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:16.118880 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-72ce3c8c-01b0-4bb2-a108-d9ac33c2a694 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:16.119413 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-72ce3c8c-01b0-4bb2-a108-d9ac33c2a694 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:16.225660 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-72ce3c8c-01b0-4bb2-a108-d9ac33c2a694 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:16:16.238349 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-72ce3c8c-01b0-4bb2-a108-d9ac33c2a694 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/da103289-634e-420f-9750-b36e4d00c641" status: 200 len: 1192 microversion: 2.1 time: 0.137112 Sep 01 14:16:16.239751 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 582/1158] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:16:16 2022] GET /compute/v2.1/servers/da103289-634e-420f-9750-b36e4d00c641 => generated 1192 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:16:16.261396 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-c8f0dec2-05e2-4982-a899-e730eed83112 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176ac62de5974fef91b59293df718ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493732d3c282440f8593558858bb0b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:16:16.271915 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-c8f0dec2-05e2-4982-a899-e730eed83112 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] 10.222.0.25 "GET /compute/v2.1/servers/2ffa4508-48a9-4498-9e28-3d7c609fa06e" status: 200 len: 1504 microversion: 2.1 time: 0.260705 Sep 01 14:16:16.272736 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 577/1159] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:16:16 2022] GET /compute/v2.1/servers/2ffa4508-48a9-4498-9e28-3d7c609fa06e => generated 1504 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:16:17.283670 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-ceea7616-c308-4176-804b-4c9f623f42d6 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:16:17.285071 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-ceea7616-c308-4176-804b-4c9f623f42d6 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: da103289-634e-420f-9750-b36e4d00c641] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:16:17.303785 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-6e1ebd97-0527-44d7-bbe4-1afabd4ab906 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:16:17.312082 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-6e1ebd97-0527-44d7-bbe4-1afabd4ab906 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] [instance: 2ffa4508-48a9-4498-9e28-3d7c609fa06e] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:16:17.321936 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ceea7616-c308-4176-804b-4c9f623f42d6 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:17.322660 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ceea7616-c308-4176-804b-4c9f623f42d6 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:17.323456 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ceea7616-c308-4176-804b-4c9f623f42d6 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:17.330527 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ceea7616-c308-4176-804b-4c9f623f42d6 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:17.333106 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6e1ebd97-0527-44d7-bbe4-1afabd4ab906 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:17.334509 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ceea7616-c308-4176-804b-4c9f623f42d6 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:17.335648 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6e1ebd97-0527-44d7-bbe4-1afabd4ab906 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:17.341078 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6e1ebd97-0527-44d7-bbe4-1afabd4ab906 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:17.341078 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6e1ebd97-0527-44d7-bbe4-1afabd4ab906 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:17.341078 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6e1ebd97-0527-44d7-bbe4-1afabd4ab906 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:17.341078 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6e1ebd97-0527-44d7-bbe4-1afabd4ab906 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:17.344881 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ceea7616-c308-4176-804b-4c9f623f42d6 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:17.518350 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-6e1ebd97-0527-44d7-bbe4-1afabd4ab906 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176ac62de5974fef91b59293df718ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493732d3c282440f8593558858bb0b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:16:17.532752 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-6e1ebd97-0527-44d7-bbe4-1afabd4ab906 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] 10.222.0.25 "GET /compute/v2.1/servers/2ffa4508-48a9-4498-9e28-3d7c609fa06e" status: 200 len: 1462 microversion: 2.1 time: 0.239173 Sep 01 14:16:17.533339 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 578/1160] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:16:17 2022] GET /compute/v2.1/servers/2ffa4508-48a9-4498-9e28-3d7c609fa06e => generated 1462 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:16:17.538940 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [req-b6a46e7b-e44f-4cbf-9184-5a53b2bf31bc req-4d1b8f2b-ced6-448a-b2e7-b78f779311e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ffa4508-48a9-4498-9e28-3d7c609fa06e", "name": "network-vif-deleted", "tag": "856de7b8-7854-4ca0-acdf-ffafb624a088"}]} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:16:17.555552 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-b6a46e7b-e44f-4cbf-9184-5a53b2bf31bc req-4d1b8f2b-ced6-448a-b2e7-b78f779311e2 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:17.555818 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-b6a46e7b-e44f-4cbf-9184-5a53b2bf31bc req-4d1b8f2b-ced6-448a-b2e7-b78f779311e2 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:17.556176 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-b6a46e7b-e44f-4cbf-9184-5a53b2bf31bc req-4d1b8f2b-ced6-448a-b2e7-b78f779311e2 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:17.570378 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.compute.server_external_events [req-b6a46e7b-e44f-4cbf-9184-5a53b2bf31bc req-4d1b8f2b-ced6-448a-b2e7-b78f779311e2 service nova] Creating event network-vif-deleted:856de7b8-7854-4ca0-acdf-ffafb624a088 for instance 2ffa4508-48a9-4498-9e28-3d7c609fa06e on hv-cinder-85221 Sep 01 14:16:17.577161 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [req-b6a46e7b-e44f-4cbf-9184-5a53b2bf31bc req-4d1b8f2b-ced6-448a-b2e7-b78f779311e2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042267 Sep 01 14:16:17.578737 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-ceea7616-c308-4176-804b-4c9f623f42d6 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:16:17.583138 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 579/1161] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:16:17.595688 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-ceea7616-c308-4176-804b-4c9f623f42d6 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/da103289-634e-420f-9750-b36e4d00c641" status: 200 len: 1210 microversion: 2.1 time: 0.330544 Sep 01 14:16:17.616996 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 583/1162] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:16:17 2022] GET /compute/v2.1/servers/da103289-634e-420f-9750-b36e4d00c641 => generated 1210 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:16:18.567273 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-f86e748e-3585-4833-b9f7-1f28ac2a9408 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:16:18.568520 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-f86e748e-3585-4833-b9f7-1f28ac2a9408 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] [instance: 2ffa4508-48a9-4498-9e28-3d7c609fa06e] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:16:18.593624 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f86e748e-3585-4833-b9f7-1f28ac2a9408 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:18.594651 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f86e748e-3585-4833-b9f7-1f28ac2a9408 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:18.595526 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f86e748e-3585-4833-b9f7-1f28ac2a9408 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:18.596778 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f86e748e-3585-4833-b9f7-1f28ac2a9408 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:18.597610 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f86e748e-3585-4833-b9f7-1f28ac2a9408 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:18.598423 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f86e748e-3585-4833-b9f7-1f28ac2a9408 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:18.637354 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-0c3d4ebd-4e34-45bb-970d-49469d6fd2ba tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:16:18.641814 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-0c3d4ebd-4e34-45bb-970d-49469d6fd2ba tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: da103289-634e-420f-9750-b36e4d00c641] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:16:18.661427 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0c3d4ebd-4e34-45bb-970d-49469d6fd2ba tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:18.662722 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0c3d4ebd-4e34-45bb-970d-49469d6fd2ba tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:18.663623 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0c3d4ebd-4e34-45bb-970d-49469d6fd2ba tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:18.665342 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0c3d4ebd-4e34-45bb-970d-49469d6fd2ba tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:18.666416 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0c3d4ebd-4e34-45bb-970d-49469d6fd2ba tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:18.667273 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0c3d4ebd-4e34-45bb-970d-49469d6fd2ba tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:18.705391 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f86e748e-3585-4833-b9f7-1f28ac2a9408 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:18.706305 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f86e748e-3585-4833-b9f7-1f28ac2a9408 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:18.707085 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f86e748e-3585-4833-b9f7-1f28ac2a9408 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:18.707893 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.objects.instance [None req-f86e748e-3585-4833-b9f7-1f28ac2a9408 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lazy-loading 'fault' on Instance uuid 2ffa4508-48a9-4498-9e28-3d7c609fa06e {{(pid=121339) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:16:18.807481 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-f86e748e-3585-4833-b9f7-1f28ac2a9408 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176ac62de5974fef91b59293df718ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '493732d3c282440f8593558858bb0b33', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:16:18.820739 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-f86e748e-3585-4833-b9f7-1f28ac2a9408 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] 10.222.0.25 "GET /compute/v2.1/servers/2ffa4508-48a9-4498-9e28-3d7c609fa06e" status: 200 len: 1304 microversion: 2.1 time: 0.261367 Sep 01 14:16:18.822113 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 580/1163] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:16:18 2022] GET /compute/v2.1/servers/2ffa4508-48a9-4498-9e28-3d7c609fa06e => generated 1304 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:16:18.935140 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-0c3d4ebd-4e34-45bb-970d-49469d6fd2ba tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:16:18.944863 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-0c3d4ebd-4e34-45bb-970d-49469d6fd2ba tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/da103289-634e-420f-9750-b36e4d00c641" status: 200 len: 1277 microversion: 2.1 time: 0.321213 Sep 01 14:16:18.945877 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 584/1164] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:16:18 2022] GET /compute/v2.1/servers/da103289-634e-420f-9750-b36e4d00c641 => generated 1277 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:16:19.861070 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-a9b355bc-2aae-4d6a-be47-a6ec6c7f8b07 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:16:19.862234 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-a9b355bc-2aae-4d6a-be47-a6ec6c7f8b07 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] [instance: 2ffa4508-48a9-4498-9e28-3d7c609fa06e] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:16:19.876001 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a9b355bc-2aae-4d6a-be47-a6ec6c7f8b07 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:19.876706 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a9b355bc-2aae-4d6a-be47-a6ec6c7f8b07 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:19.877177 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a9b355bc-2aae-4d6a-be47-a6ec6c7f8b07 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:19.877946 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [req-0689a33c-99a6-4228-9588-44f9287dcd56 req-5a1dcaae-a851-4fe2-acaa-4c116b3dbb03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da103289-634e-420f-9750-b36e4d00c641", "tag": "a35baeba-2fc3-441f-b089-15255aad1de1"}]} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:16:19.878813 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a9b355bc-2aae-4d6a-be47-a6ec6c7f8b07 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:19.878813 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a9b355bc-2aae-4d6a-be47-a6ec6c7f8b07 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:19.879294 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a9b355bc-2aae-4d6a-be47-a6ec6c7f8b07 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:19.891116 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-0689a33c-99a6-4228-9588-44f9287dcd56 req-5a1dcaae-a851-4fe2-acaa-4c116b3dbb03 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:19.892009 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-0689a33c-99a6-4228-9588-44f9287dcd56 req-5a1dcaae-a851-4fe2-acaa-4c116b3dbb03 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:19.893621 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-0689a33c-99a6-4228-9588-44f9287dcd56 req-5a1dcaae-a851-4fe2-acaa-4c116b3dbb03 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:19.908040 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.compute.server_external_events [req-0689a33c-99a6-4228-9588-44f9287dcd56 req-5a1dcaae-a851-4fe2-acaa-4c116b3dbb03 service nova] Creating event network-changed:a35baeba-2fc3-441f-b089-15255aad1de1 for instance da103289-634e-420f-9750-b36e4d00c641 on hv-cinder-85221 Sep 01 14:16:19.908761 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.wsgi [None req-a9b355bc-2aae-4d6a-be47-a6ec6c7f8b07 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] HTTP exception thrown: Instance 2ffa4508-48a9-4498-9e28-3d7c609fa06e could not be found. Sep 01 14:16:19.911747 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-a9b355bc-2aae-4d6a-be47-a6ec6c7f8b07 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Request method failure captured: Sep 01 14:16:19.911747 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: request: GET /compute/v2.1/servers/2ffa4508-48a9-4498-9e28-3d7c609fa06e HTTP/1.1 Sep 01 14:16:19.911747 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept: application/json Sep 01 14:16:19.911747 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept-Encoding: identity Sep 01 14:16:19.911747 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Connection: close Sep 01 14:16:19.911747 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Length: 0 Sep 01 14:16:19.911747 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Type: application/json Sep 01 14:16:19.911747 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Host: 10.222.0.25 Sep 01 14:16:19.911747 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Openstack-System-Scope: None Sep 01 14:16:19.911747 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: User-Agent: python-urllib3/1.26.12 Sep 01 14:16:19.911747 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Auth-Token: gAAAAABjEL6CcG7DwwphPpZr4EmHIOrI1oLwEmxuHdwntgW9Ntsn0ifzcnW52pQprgaGrqloy9ajbZu5EKKsuLCDT2XQx-z5KAuvdSLuuzH3Oau8jdqE7CnnLtDnw3TufzqLP-iW8VaUrkbesPseLV5UtPZql0GxmhUrZz-nT2I80X4rCXljh1g Sep 01 14:16:19.911747 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Id: None Sep 01 14:16:19.911747 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Name: None Sep 01 14:16:19.911747 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Identity-Status: Confirmed Sep 01 14:16:19.911747 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Is-Admin-Project: True Sep 01 14:16:19.911747 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Id: default Sep 01 14:16:19.911747 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Name: Default Sep 01 14:16:19.911747 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Id: 493732d3c282440f8593558858bb0b33 Sep 01 14:16:19.911747 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Name: tempest-VolumesActionsTest-167410230 Sep 01 14:16:19.911747 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Role: member,reader Sep 01 14:16:19.911747 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Roles: member,reader Sep 01 14:16:19.916559 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/493732d3c282440f8593558858bb0b33"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/493732d3c282440f8593558858bb0b33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/493732d3c282440f8593558858bb0b33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_493732d3c282440f8593558858bb0b33"}]}] Sep 01 14:16:19.916559 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant: tempest-VolumesActionsTest-167410230 Sep 01 14:16:19.916559 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Id: 493732d3c282440f8593558858bb0b33 Sep 01 14:16:19.916559 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Name: tempest-VolumesActionsTest-167410230 Sep 01 14:16:19.916559 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User: tempest-VolumesActionsTest-167410230-project Sep 01 14:16:19.916559 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Id: default Sep 01 14:16:19.916559 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Name: Default Sep 01 14:16:19.916559 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Id: 176ac62de5974fef91b59293df718ebc Sep 01 14:16:19.916559 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Name: tempest-VolumesActionsTest-167410230-project Sep 01 14:16:19.916559 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: method: > Sep 01 14:16:19.916559 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: exception: Instance 2ffa4508-48a9-4498-9e28-3d7c609fa06e could not be found. Sep 01 14:16:19.916559 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: action_args: {'id': '2ffa4508-48a9-4498-9e28-3d7c609fa06e'} Sep 01 14:16:19.918481 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:16:19.918481 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:16:19.918481 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:16:19.918481 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:16:19.918481 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:16:19.918481 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:16:19.918481 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:16:19.918481 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:16:19.918481 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:16:19.918481 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:16:19.918481 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ffa4508-48a9-4498-9e28-3d7c609fa06e could not be found. Sep 01 14:16:19.918481 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:16:19.918481 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:16:19.918481 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:16:19.918481 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:16:19.918481 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:16:19.918481 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:16:19.918481 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:16:19.918481 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:16:19.918481 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:16:19.921721 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:16:19.921721 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:16:19.921721 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:16:19.921721 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:16:19.921721 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:16:19.921721 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:16:19.921721 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:16:19.921721 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ffa4508-48a9-4498-9e28-3d7c609fa06e could not be found. Sep 01 14:16:19.921721 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:16:19.921721 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:16:19.921721 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:16:19.921721 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:16:19.921721 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:16:19.921721 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:16:19.921721 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:16:19.921721 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:16:19.921721 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ffa4508-48a9-4498-9e28-3d7c609fa06e could not be found. Sep 01 14:16:19.921721 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:16:19.924294 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-a9b355bc-2aae-4d6a-be47-a6ec6c7f8b07 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] Returning 404 to user: Instance 2ffa4508-48a9-4498-9e28-3d7c609fa06e could not be found. {{(pid=121339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:16:19.924294 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-a9b355bc-2aae-4d6a-be47-a6ec6c7f8b07 tempest-VolumesActionsTest-167410230 tempest-VolumesActionsTest-167410230-project] 10.222.0.25 "GET /compute/v2.1/servers/2ffa4508-48a9-4498-9e28-3d7c609fa06e" status: 404 len: 111 microversion: 2.1 time: 0.060744 Sep 01 14:16:19.925095 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [req-0689a33c-99a6-4228-9588-44f9287dcd56 req-5a1dcaae-a851-4fe2-acaa-4c116b3dbb03 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042905 Sep 01 14:16:19.925263 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 581/1165] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:16:19 2022] GET /compute/v2.1/servers/2ffa4508-48a9-4498-9e28-3d7c609fa06e => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:16:19.925429 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 585/1166] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:16:19.975272 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-6cd93df8-0900-43d1-b066-9b9b3bca7221 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:16:19.985461 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-6cd93df8-0900-43d1-b066-9b9b3bca7221 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: da103289-634e-420f-9750-b36e4d00c641] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:16:19.985461 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6cd93df8-0900-43d1-b066-9b9b3bca7221 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:19.985461 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6cd93df8-0900-43d1-b066-9b9b3bca7221 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:19.985461 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6cd93df8-0900-43d1-b066-9b9b3bca7221 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:19.986268 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6cd93df8-0900-43d1-b066-9b9b3bca7221 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:19.986268 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6cd93df8-0900-43d1-b066-9b9b3bca7221 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:19.986268 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6cd93df8-0900-43d1-b066-9b9b3bca7221 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:20.218483 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-6cd93df8-0900-43d1-b066-9b9b3bca7221 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:16:20.230712 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-6cd93df8-0900-43d1-b066-9b9b3bca7221 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/da103289-634e-420f-9750-b36e4d00c641" status: 200 len: 1265 microversion: 2.1 time: 0.259594 Sep 01 14:16:20.231469 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 582/1167] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:16:19 2022] GET /compute/v2.1/servers/da103289-634e-420f-9750-b36e4d00c641 => generated 1265 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:16:21.258476 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-cff8c331-0f3c-49c2-bff1-435d8fa73ddb tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:16:21.259818 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-cff8c331-0f3c-49c2-bff1-435d8fa73ddb tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: da103289-634e-420f-9750-b36e4d00c641] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:16:21.267608 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-cff8c331-0f3c-49c2-bff1-435d8fa73ddb tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:21.268229 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-cff8c331-0f3c-49c2-bff1-435d8fa73ddb tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:21.268884 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-cff8c331-0f3c-49c2-bff1-435d8fa73ddb tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:21.269802 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-cff8c331-0f3c-49c2-bff1-435d8fa73ddb tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:21.270369 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-cff8c331-0f3c-49c2-bff1-435d8fa73ddb tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:21.270950 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-cff8c331-0f3c-49c2-bff1-435d8fa73ddb tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:21.292782 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:21.561885 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-cff8c331-0f3c-49c2-bff1-435d8fa73ddb tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:16:21.574737 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-cff8c331-0f3c-49c2-bff1-435d8fa73ddb tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/da103289-634e-420f-9750-b36e4d00c641" status: 200 len: 1265 microversion: 2.1 time: 0.321686 Sep 01 14:16:21.576016 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 586/1168] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:16:21 2022] GET /compute/v2.1/servers/da103289-634e-420f-9750-b36e4d00c641 => generated 1265 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:16:22.599285 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-505937f9-4380-43f5-8199-d9d2d67158cc tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:16:22.600200 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-505937f9-4380-43f5-8199-d9d2d67158cc tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: da103289-634e-420f-9750-b36e4d00c641] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:16:22.610882 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-505937f9-4380-43f5-8199-d9d2d67158cc tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:22.611511 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-505937f9-4380-43f5-8199-d9d2d67158cc tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:22.617781 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-505937f9-4380-43f5-8199-d9d2d67158cc tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:22.617781 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-505937f9-4380-43f5-8199-d9d2d67158cc tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:22.617781 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-505937f9-4380-43f5-8199-d9d2d67158cc tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:22.617781 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-505937f9-4380-43f5-8199-d9d2d67158cc tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:22.766771 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-505937f9-4380-43f5-8199-d9d2d67158cc tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:16:22.776301 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-505937f9-4380-43f5-8199-d9d2d67158cc tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/da103289-634e-420f-9750-b36e4d00c641" status: 200 len: 1265 microversion: 2.1 time: 0.181023 Sep 01 14:16:22.777051 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 583/1169] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:16:22 2022] GET /compute/v2.1/servers/da103289-634e-420f-9750-b36e4d00c641 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:16:23.799890 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-f4420255-fee9-47ac-ba03-981673310d97 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:16:23.800532 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-f4420255-fee9-47ac-ba03-981673310d97 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: da103289-634e-420f-9750-b36e4d00c641] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:16:23.802653 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell0:SELECT=2 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:23.803334 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell0:SELECT=6 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:23.813550 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f4420255-fee9-47ac-ba03-981673310d97 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:23.813550 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f4420255-fee9-47ac-ba03-981673310d97 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:23.813550 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f4420255-fee9-47ac-ba03-981673310d97 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:23.813550 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f4420255-fee9-47ac-ba03-981673310d97 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:23.814300 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f4420255-fee9-47ac-ba03-981673310d97 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:23.814300 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f4420255-fee9-47ac-ba03-981673310d97 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:23.979779 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-f4420255-fee9-47ac-ba03-981673310d97 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:16:23.988690 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-f4420255-fee9-47ac-ba03-981673310d97 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/da103289-634e-420f-9750-b36e4d00c641" status: 200 len: 1265 microversion: 2.1 time: 0.193319 Sep 01 14:16:23.989922 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 587/1170] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:16:23 2022] GET /compute/v2.1/servers/da103289-634e-420f-9750-b36e4d00c641 => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:16:25.021797 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-0df9e6a8-5e03-4259-a4db-0e8084119d97 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:16:25.022499 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-0df9e6a8-5e03-4259-a4db-0e8084119d97 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: da103289-634e-420f-9750-b36e4d00c641] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:16:25.025397 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell0:SELECT=4 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:16:25.030617 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0df9e6a8-5e03-4259-a4db-0e8084119d97 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:25.031109 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0df9e6a8-5e03-4259-a4db-0e8084119d97 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:25.031547 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0df9e6a8-5e03-4259-a4db-0e8084119d97 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:25.032289 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0df9e6a8-5e03-4259-a4db-0e8084119d97 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:25.032813 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0df9e6a8-5e03-4259-a4db-0e8084119d97 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:25.033246 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0df9e6a8-5e03-4259-a4db-0e8084119d97 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:25.183107 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-0df9e6a8-5e03-4259-a4db-0e8084119d97 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:16:25.191270 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-0df9e6a8-5e03-4259-a4db-0e8084119d97 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/da103289-634e-420f-9750-b36e4d00c641" status: 200 len: 1265 microversion: 2.1 time: 0.173661 Sep 01 14:16:25.191883 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 584/1171] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:16:25 2022] GET /compute/v2.1/servers/da103289-634e-420f-9750-b36e4d00c641 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:16:26.213986 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-f182ec42-5099-4c50-a3ec-ad477041d741 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:16:26.214633 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-f182ec42-5099-4c50-a3ec-ad477041d741 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: da103289-634e-420f-9750-b36e4d00c641] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:16:26.225653 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f182ec42-5099-4c50-a3ec-ad477041d741 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:26.226192 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f182ec42-5099-4c50-a3ec-ad477041d741 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:26.227406 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f182ec42-5099-4c50-a3ec-ad477041d741 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:26.228022 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f182ec42-5099-4c50-a3ec-ad477041d741 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:26.228489 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f182ec42-5099-4c50-a3ec-ad477041d741 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:26.228923 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f182ec42-5099-4c50-a3ec-ad477041d741 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:26.455194 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-f182ec42-5099-4c50-a3ec-ad477041d741 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:16:26.464430 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-f182ec42-5099-4c50-a3ec-ad477041d741 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/da103289-634e-420f-9750-b36e4d00c641" status: 200 len: 1265 microversion: 2.1 time: 0.255468 Sep 01 14:16:26.477872 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 588/1172] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:16:26 2022] GET /compute/v2.1/servers/da103289-634e-420f-9750-b36e4d00c641 => generated 1265 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:16:27.499543 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-f62fdd5b-9e72-4aef-80c7-9fe09e726d0b tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:16:27.504045 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-f62fdd5b-9e72-4aef-80c7-9fe09e726d0b tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: da103289-634e-420f-9750-b36e4d00c641] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:16:27.517468 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f62fdd5b-9e72-4aef-80c7-9fe09e726d0b tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:27.518764 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f62fdd5b-9e72-4aef-80c7-9fe09e726d0b tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:27.519490 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f62fdd5b-9e72-4aef-80c7-9fe09e726d0b tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:27.521262 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f62fdd5b-9e72-4aef-80c7-9fe09e726d0b tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:27.522551 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f62fdd5b-9e72-4aef-80c7-9fe09e726d0b tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:27.523535 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f62fdd5b-9e72-4aef-80c7-9fe09e726d0b tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:27.776615 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-f62fdd5b-9e72-4aef-80c7-9fe09e726d0b tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:16:27.788367 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-f62fdd5b-9e72-4aef-80c7-9fe09e726d0b tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/da103289-634e-420f-9750-b36e4d00c641" status: 200 len: 1265 microversion: 2.1 time: 0.305843 Sep 01 14:16:27.801926 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 585/1173] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:16:27 2022] GET /compute/v2.1/servers/da103289-634e-420f-9750-b36e4d00c641 => generated 1265 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:16:28.815085 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-121af69c-d026-4141-bdb1-5b3250251d07 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:16:28.816410 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-121af69c-d026-4141-bdb1-5b3250251d07 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: da103289-634e-420f-9750-b36e4d00c641] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:16:28.844581 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-121af69c-d026-4141-bdb1-5b3250251d07 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:28.845408 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-121af69c-d026-4141-bdb1-5b3250251d07 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:28.846781 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-121af69c-d026-4141-bdb1-5b3250251d07 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:28.848158 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-121af69c-d026-4141-bdb1-5b3250251d07 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:28.848994 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-121af69c-d026-4141-bdb1-5b3250251d07 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:28.849798 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-121af69c-d026-4141-bdb1-5b3250251d07 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:29.372668 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-121af69c-d026-4141-bdb1-5b3250251d07 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:16:29.391229 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-121af69c-d026-4141-bdb1-5b3250251d07 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/da103289-634e-420f-9750-b36e4d00c641" status: 200 len: 1265 microversion: 2.1 time: 0.579199 Sep 01 14:16:29.405928 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 589/1174] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:16:28 2022] GET /compute/v2.1/servers/da103289-634e-420f-9750-b36e4d00c641 => generated 1265 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:16:30.414970 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-565012be-a52d-42e4-adb9-6517871e0865 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:16:30.416277 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-565012be-a52d-42e4-adb9-6517871e0865 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: da103289-634e-420f-9750-b36e4d00c641] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:16:30.428013 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-565012be-a52d-42e4-adb9-6517871e0865 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:30.428499 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-565012be-a52d-42e4-adb9-6517871e0865 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:30.429144 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-565012be-a52d-42e4-adb9-6517871e0865 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:30.430116 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-565012be-a52d-42e4-adb9-6517871e0865 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:30.430753 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-565012be-a52d-42e4-adb9-6517871e0865 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:30.431503 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-565012be-a52d-42e4-adb9-6517871e0865 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:30.611841 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-565012be-a52d-42e4-adb9-6517871e0865 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:16:30.623149 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-565012be-a52d-42e4-adb9-6517871e0865 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/da103289-634e-420f-9750-b36e4d00c641" status: 200 len: 1265 microversion: 2.1 time: 0.212226 Sep 01 14:16:30.624313 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 586/1175] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:16:30 2022] GET /compute/v2.1/servers/da103289-634e-420f-9750-b36e4d00c641 => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:16:30.964551 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [req-85481af3-2b9c-48b4-9bf7-e0e1a834b856 req-007c6fe6-2185-4b6a-8b1c-a33aacde1de0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da103289-634e-420f-9750-b36e4d00c641", "name": "network-vif-plugged", "status": "completed", "tag": "a35baeba-2fc3-441f-b089-15255aad1de1"}]} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:16:30.985093 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-85481af3-2b9c-48b4-9bf7-e0e1a834b856 req-007c6fe6-2185-4b6a-8b1c-a33aacde1de0 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:30.985588 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-85481af3-2b9c-48b4-9bf7-e0e1a834b856 req-007c6fe6-2185-4b6a-8b1c-a33aacde1de0 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:30.986056 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-85481af3-2b9c-48b4-9bf7-e0e1a834b856 req-007c6fe6-2185-4b6a-8b1c-a33aacde1de0 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:31.000502 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.compute.server_external_events [req-85481af3-2b9c-48b4-9bf7-e0e1a834b856 req-007c6fe6-2185-4b6a-8b1c-a33aacde1de0 service nova] Creating event network-vif-plugged:a35baeba-2fc3-441f-b089-15255aad1de1 for instance da103289-634e-420f-9750-b36e4d00c641 on hv-cinder-85221 Sep 01 14:16:31.011731 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [req-85481af3-2b9c-48b4-9bf7-e0e1a834b856 req-007c6fe6-2185-4b6a-8b1c-a33aacde1de0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054137 Sep 01 14:16:31.013743 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 590/1176] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:16:31.657864 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-a50140b3-4dce-4448-91bb-834ae831bbdc tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:16:31.670884 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-a50140b3-4dce-4448-91bb-834ae831bbdc tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: da103289-634e-420f-9750-b36e4d00c641] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:16:31.688170 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a50140b3-4dce-4448-91bb-834ae831bbdc tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:31.690382 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a50140b3-4dce-4448-91bb-834ae831bbdc tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:31.692267 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a50140b3-4dce-4448-91bb-834ae831bbdc tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:31.696029 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a50140b3-4dce-4448-91bb-834ae831bbdc tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:31.697749 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a50140b3-4dce-4448-91bb-834ae831bbdc tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:31.698981 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-a50140b3-4dce-4448-91bb-834ae831bbdc tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:32.113977 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-a50140b3-4dce-4448-91bb-834ae831bbdc tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:16:32.132654 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-a50140b3-4dce-4448-91bb-834ae831bbdc tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/da103289-634e-420f-9750-b36e4d00c641" status: 200 len: 1265 microversion: 2.1 time: 0.488184 Sep 01 14:16:32.134725 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 587/1177] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:16:31 2022] GET /compute/v2.1/servers/da103289-634e-420f-9750-b36e4d00c641 => generated 1265 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:16:33.160314 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-971d40e6-41c0-47bd-b425-0e35933d29c3 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:16:33.161999 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-971d40e6-41c0-47bd-b425-0e35933d29c3 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: da103289-634e-420f-9750-b36e4d00c641] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:16:33.174014 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-971d40e6-41c0-47bd-b425-0e35933d29c3 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:33.174794 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-971d40e6-41c0-47bd-b425-0e35933d29c3 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:33.175487 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-971d40e6-41c0-47bd-b425-0e35933d29c3 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:33.176832 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-971d40e6-41c0-47bd-b425-0e35933d29c3 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:33.177981 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-971d40e6-41c0-47bd-b425-0e35933d29c3 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:33.180235 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-971d40e6-41c0-47bd-b425-0e35933d29c3 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:33.412797 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-971d40e6-41c0-47bd-b425-0e35933d29c3 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:16:33.432241 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-971d40e6-41c0-47bd-b425-0e35933d29c3 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/da103289-634e-420f-9750-b36e4d00c641" status: 200 len: 1265 microversion: 2.1 time: 0.280119 Sep 01 14:16:33.433398 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 591/1178] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:16:33 2022] GET /compute/v2.1/servers/da103289-634e-420f-9750-b36e4d00c641 => generated 1265 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:16:34.461952 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-6456077f-25c3-4634-9700-f9ad4b0fb994 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:16:34.464357 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-6456077f-25c3-4634-9700-f9ad4b0fb994 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: da103289-634e-420f-9750-b36e4d00c641] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:16:34.478799 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6456077f-25c3-4634-9700-f9ad4b0fb994 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:34.480106 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6456077f-25c3-4634-9700-f9ad4b0fb994 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:34.481232 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6456077f-25c3-4634-9700-f9ad4b0fb994 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:34.483210 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6456077f-25c3-4634-9700-f9ad4b0fb994 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:34.484447 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6456077f-25c3-4634-9700-f9ad4b0fb994 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:34.485852 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-6456077f-25c3-4634-9700-f9ad4b0fb994 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:34.724935 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-6456077f-25c3-4634-9700-f9ad4b0fb994 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:16:34.747670 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-6456077f-25c3-4634-9700-f9ad4b0fb994 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/da103289-634e-420f-9750-b36e4d00c641" status: 200 len: 1452 microversion: 2.1 time: 0.295132 Sep 01 14:16:34.764640 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 588/1179] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:16:34 2022] GET /compute/v2.1/servers/da103289-634e-420f-9750-b36e4d00c641 => generated 1452 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:16:34.785427 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-06a92d04-f006-43ee-b9e5-7597b29dbdb3 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:16:34.786941 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-06a92d04-f006-43ee-b9e5-7597b29dbdb3 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: da103289-634e-420f-9750-b36e4d00c641] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:16:34.795090 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-06a92d04-f006-43ee-b9e5-7597b29dbdb3 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:34.815413 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-06a92d04-f006-43ee-b9e5-7597b29dbdb3 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:34.815413 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-06a92d04-f006-43ee-b9e5-7597b29dbdb3 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:34.815413 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-06a92d04-f006-43ee-b9e5-7597b29dbdb3 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:34.815413 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-06a92d04-f006-43ee-b9e5-7597b29dbdb3 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:34.815869 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-06a92d04-f006-43ee-b9e5-7597b29dbdb3 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:35.029925 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-06a92d04-f006-43ee-b9e5-7597b29dbdb3 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:16:35.043332 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-06a92d04-f006-43ee-b9e5-7597b29dbdb3 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/da103289-634e-420f-9750-b36e4d00c641" status: 200 len: 1452 microversion: 2.1 time: 0.262195 Sep 01 14:16:35.044794 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 592/1180] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:16:34 2022] GET /compute/v2.1/servers/da103289-634e-420f-9750-b36e4d00c641 => generated 1452 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:16:39.063010 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [req-f0028f0c-6e93-4ad5-b014-0eb2ab3dd639 req-668bed16-9d3f-42e2-84db-8dd983e163c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da103289-634e-420f-9750-b36e4d00c641", "tag": "a35baeba-2fc3-441f-b089-15255aad1de1"}]} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:16:39.093109 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-f0028f0c-6e93-4ad5-b014-0eb2ab3dd639 req-668bed16-9d3f-42e2-84db-8dd983e163c0 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:16:39.094224 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-f0028f0c-6e93-4ad5-b014-0eb2ab3dd639 req-668bed16-9d3f-42e2-84db-8dd983e163c0 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:16:39.095930 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-f0028f0c-6e93-4ad5-b014-0eb2ab3dd639 req-668bed16-9d3f-42e2-84db-8dd983e163c0 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:16:39.132685 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.compute.server_external_events [req-f0028f0c-6e93-4ad5-b014-0eb2ab3dd639 req-668bed16-9d3f-42e2-84db-8dd983e163c0 service nova] Creating event network-changed:a35baeba-2fc3-441f-b089-15255aad1de1 for instance da103289-634e-420f-9750-b36e4d00c641 on hv-cinder-85221 Sep 01 14:16:39.157617 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [req-f0028f0c-6e93-4ad5-b014-0eb2ab3dd639 req-668bed16-9d3f-42e2-84db-8dd983e163c0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.431876 Sep 01 14:16:39.159172 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 589/1181] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:18:22.677144 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR oslo.messaging._drivers.impl_rabbit [-] [41d22448-7519-4ff6-bd46-628e22da626f] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 01 14:18:22.678190 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:18:22.679104 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell1:SELECT=35 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:18:22.680853 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 14:18:22.681033 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Thu Sep 1 14:18:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.25) !!! Sep 01 14:18:22.686890 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-aea86db1-0942-49a8-98b3-1dd1183579dd tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-959660933", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1695617707", "security_groups": [{"name": "tempest-secgroup-smoke-597656021"}], "block_device_mapping_v2": [{"uuid": "beb75a88-1d70-4817-b04e-bb1bd4a55447", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ebd60ad1-5f3d-4543-91a0-ad7aa3eae6b0"}]}} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:18:22.832939 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.network.neutron [None req-aea86db1-0942-49a8-98b3-1dd1183579dd tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] validate_networks() for [('ebd60ad1-5f3d-4543-91a0-ad7aa3eae6b0', None, None, None, None, None)] {{(pid=121340) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:18:23.690112 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-aea86db1-0942-49a8-98b3-1dd1183579dd tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Flavor limits 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:18:23.691214 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-aea86db1-0942-49a8-98b3-1dd1183579dd tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Image limits 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:18:23.691214 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-aea86db1-0942-49a8-98b3-1dd1183579dd tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Flavor pref 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:18:23.691563 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-aea86db1-0942-49a8-98b3-1dd1183579dd tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Image pref 0:0:0 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:18:23.691946 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.virt.hardware [None req-aea86db1-0942-49a8-98b3-1dd1183579dd tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:18:23.696383 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO oslo.messaging._drivers.impl_rabbit [-] [41d22448-7519-4ff6-bd46-628e22da626f] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 59994. Sep 01 14:18:23.704358 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-aea86db1-0942-49a8-98b3-1dd1183579dd tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:18:23.704932 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-aea86db1-0942-49a8-98b3-1dd1183579dd tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:18:23.705463 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-aea86db1-0942-49a8-98b3-1dd1183579dd tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:18:23.706892 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-aea86db1-0942-49a8-98b3-1dd1183579dd tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:18:23.707765 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-aea86db1-0942-49a8-98b3-1dd1183579dd tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:18:23.707981 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-aea86db1-0942-49a8-98b3-1dd1183579dd tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:18:23.728962 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.quota [None req-aea86db1-0942-49a8-98b3-1dd1183579dd tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Getting quotas for project 8acdb976501045c0813d16f3d0ffd13d. Resources: {'cores', 'instances', 'ram'} {{(pid=121340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:18:23.734028 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.quota [None req-aea86db1-0942-49a8-98b3-1dd1183579dd tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Getting quotas for user 93f843d15d194f0b9f44ec33c49b9b4c and project 8acdb976501045c0813d16f3d0ffd13d. Resources: {'cores', 'instances', 'ram'} {{(pid=121340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:18:23.800193 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-aea86db1-0942-49a8-98b3-1dd1183579dd tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Going to run 1 instances... {{(pid=121340) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:18:23.802857 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-aea86db1-0942-49a8-98b3-1dd1183579dd tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: 397a9d6e-2200-46c1-8e47-26aa9d406ab3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='beb75a88-1d70-4817-b04e-bb1bd4a55447',volume_size=None,volume_type=None)] {{(pid=121340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:18:24.229515 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-aea86db1-0942-49a8-98b3-1dd1183579dd tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.555240 Sep 01 14:18:24.236992 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 593/1182] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 1 14:18:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 1558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 14:18:24.244279 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_api:SELECT=43 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:18:24.246475 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell1:SELECT=89 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:18:24.247712 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 14:18:24.247909 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Thu Sep 1 14:18:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/397a9d6e-2200-46c1-8e47-26aa9d406ab3 (ip 10.222.0.25) !!! Sep 01 14:18:24.273970 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-8096714b-e958-4fed-92df-87e63186d936 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:18:24.275905 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-8096714b-e958-4fed-92df-87e63186d936 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: 397a9d6e-2200-46c1-8e47-26aa9d406ab3] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:18:24.361844 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-8096714b-e958-4fed-92df-87e63186d936 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:18:24.373252 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-8096714b-e958-4fed-92df-87e63186d936 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/397a9d6e-2200-46c1-8e47-26aa9d406ab3" status: 200 len: 1094 microversion: 2.1 time: 0.131994 Sep 01 14:18:24.373737 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 590/1183] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:18:24 2022] GET /compute/v2.1/servers/397a9d6e-2200-46c1-8e47-26aa9d406ab3 => generated 1094 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:18:25.399629 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-c15e8490-55b5-45e5-a4df-312ba94efa73 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:18:25.400323 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-c15e8490-55b5-45e5-a4df-312ba94efa73 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: 397a9d6e-2200-46c1-8e47-26aa9d406ab3] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:18:25.407182 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c15e8490-55b5-45e5-a4df-312ba94efa73 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:18:25.407695 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c15e8490-55b5-45e5-a4df-312ba94efa73 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:18:25.408191 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c15e8490-55b5-45e5-a4df-312ba94efa73 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:18:25.408947 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c15e8490-55b5-45e5-a4df-312ba94efa73 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:18:25.409430 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c15e8490-55b5-45e5-a4df-312ba94efa73 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:18:25.409943 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-c15e8490-55b5-45e5-a4df-312ba94efa73 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:18:25.494376 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-c15e8490-55b5-45e5-a4df-312ba94efa73 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:18:25.504557 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-c15e8490-55b5-45e5-a4df-312ba94efa73 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/397a9d6e-2200-46c1-8e47-26aa9d406ab3" status: 200 len: 1144 microversion: 2.1 time: 0.109683 Sep 01 14:18:25.506061 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 594/1184] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:18:25 2022] GET /compute/v2.1/servers/397a9d6e-2200-46c1-8e47-26aa9d406ab3 => generated 1144 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:18:26.526293 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-f615b66a-727d-4d81-a57e-3f0aa8eaaaa5 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:18:26.527105 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-f615b66a-727d-4d81-a57e-3f0aa8eaaaa5 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: 397a9d6e-2200-46c1-8e47-26aa9d406ab3] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:18:26.537348 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f615b66a-727d-4d81-a57e-3f0aa8eaaaa5 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:18:26.541469 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f615b66a-727d-4d81-a57e-3f0aa8eaaaa5 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:18:26.541469 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f615b66a-727d-4d81-a57e-3f0aa8eaaaa5 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:18:26.541469 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f615b66a-727d-4d81-a57e-3f0aa8eaaaa5 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:18:26.541469 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f615b66a-727d-4d81-a57e-3f0aa8eaaaa5 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:18:26.542407 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-f615b66a-727d-4d81-a57e-3f0aa8eaaaa5 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:18:26.666440 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-f615b66a-727d-4d81-a57e-3f0aa8eaaaa5 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:18:26.680360 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-f615b66a-727d-4d81-a57e-3f0aa8eaaaa5 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/397a9d6e-2200-46c1-8e47-26aa9d406ab3" status: 200 len: 1200 microversion: 2.1 time: 0.158235 Sep 01 14:18:26.681782 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 591/1185] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:18:26 2022] GET /compute/v2.1/servers/397a9d6e-2200-46c1-8e47-26aa9d406ab3 => generated 1200 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:18:27.705095 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-6d6a325c-d2ca-4d7b-b146-d21c37bf1fe0 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:18:27.707420 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-6d6a325c-d2ca-4d7b-b146-d21c37bf1fe0 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: 397a9d6e-2200-46c1-8e47-26aa9d406ab3] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:18:27.720909 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6d6a325c-d2ca-4d7b-b146-d21c37bf1fe0 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:18:27.721714 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6d6a325c-d2ca-4d7b-b146-d21c37bf1fe0 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:18:27.722872 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6d6a325c-d2ca-4d7b-b146-d21c37bf1fe0 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:18:27.723790 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6d6a325c-d2ca-4d7b-b146-d21c37bf1fe0 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:18:27.724363 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6d6a325c-d2ca-4d7b-b146-d21c37bf1fe0 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:18:27.724893 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6d6a325c-d2ca-4d7b-b146-d21c37bf1fe0 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:18:28.007706 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-6d6a325c-d2ca-4d7b-b146-d21c37bf1fe0 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:18:28.023009 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-6d6a325c-d2ca-4d7b-b146-d21c37bf1fe0 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/397a9d6e-2200-46c1-8e47-26aa9d406ab3" status: 200 len: 1277 microversion: 2.1 time: 0.322796 Sep 01 14:18:28.024395 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 595/1186] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:18:27 2022] GET /compute/v2.1/servers/397a9d6e-2200-46c1-8e47-26aa9d406ab3 => generated 1277 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:18:28.864316 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [req-c504f333-22b5-4c81-93e3-113ffcfcce52 req-62d3be81-f95b-463a-93e2-4c02cef965c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "397a9d6e-2200-46c1-8e47-26aa9d406ab3", "tag": "eecd28cb-3ec6-44bb-9bad-77c2c70db92a"}]} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:18:28.875612 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-c504f333-22b5-4c81-93e3-113ffcfcce52 req-62d3be81-f95b-463a-93e2-4c02cef965c9 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:18:28.876093 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-c504f333-22b5-4c81-93e3-113ffcfcce52 req-62d3be81-f95b-463a-93e2-4c02cef965c9 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:18:28.876708 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-c504f333-22b5-4c81-93e3-113ffcfcce52 req-62d3be81-f95b-463a-93e2-4c02cef965c9 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:18:28.889305 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.compute.server_external_events [req-c504f333-22b5-4c81-93e3-113ffcfcce52 req-62d3be81-f95b-463a-93e2-4c02cef965c9 service nova] Creating event network-changed:eecd28cb-3ec6-44bb-9bad-77c2c70db92a for instance 397a9d6e-2200-46c1-8e47-26aa9d406ab3 on hv-cinder-85221 Sep 01 14:18:28.896158 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [req-c504f333-22b5-4c81-93e3-113ffcfcce52 req-62d3be81-f95b-463a-93e2-4c02cef965c9 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035971 Sep 01 14:18:28.898143 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 592/1187] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:18:29.062267 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-ee38a6c2-01e4-4d53-b01d-318fb7ff2518 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:18:29.063397 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-ee38a6c2-01e4-4d53-b01d-318fb7ff2518 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: 397a9d6e-2200-46c1-8e47-26aa9d406ab3] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:18:29.072778 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ee38a6c2-01e4-4d53-b01d-318fb7ff2518 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:18:29.073267 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ee38a6c2-01e4-4d53-b01d-318fb7ff2518 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:18:29.073713 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ee38a6c2-01e4-4d53-b01d-318fb7ff2518 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:18:29.074479 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ee38a6c2-01e4-4d53-b01d-318fb7ff2518 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:18:29.074914 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ee38a6c2-01e4-4d53-b01d-318fb7ff2518 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:18:29.075333 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-ee38a6c2-01e4-4d53-b01d-318fb7ff2518 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:18:29.307209 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-ee38a6c2-01e4-4d53-b01d-318fb7ff2518 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:18:29.317574 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-ee38a6c2-01e4-4d53-b01d-318fb7ff2518 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/397a9d6e-2200-46c1-8e47-26aa9d406ab3" status: 200 len: 1265 microversion: 2.1 time: 0.262530 Sep 01 14:18:29.318392 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 596/1188] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:18:29 2022] GET /compute/v2.1/servers/397a9d6e-2200-46c1-8e47-26aa9d406ab3 => generated 1265 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:18:30.348082 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-5f5a6ca6-b0b8-46da-8f1d-acac4807b294 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:18:30.348773 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-5f5a6ca6-b0b8-46da-8f1d-acac4807b294 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: 397a9d6e-2200-46c1-8e47-26aa9d406ab3] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:18:30.357083 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5f5a6ca6-b0b8-46da-8f1d-acac4807b294 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:18:30.357623 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5f5a6ca6-b0b8-46da-8f1d-acac4807b294 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:18:30.358114 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5f5a6ca6-b0b8-46da-8f1d-acac4807b294 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:18:30.358843 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5f5a6ca6-b0b8-46da-8f1d-acac4807b294 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:18:30.359305 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5f5a6ca6-b0b8-46da-8f1d-acac4807b294 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:18:30.359738 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5f5a6ca6-b0b8-46da-8f1d-acac4807b294 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:18:30.521317 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-5f5a6ca6-b0b8-46da-8f1d-acac4807b294 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:18:30.536320 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-5f5a6ca6-b0b8-46da-8f1d-acac4807b294 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/397a9d6e-2200-46c1-8e47-26aa9d406ab3" status: 200 len: 1265 microversion: 2.1 time: 0.193514 Sep 01 14:18:30.537418 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 593/1189] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:18:30 2022] GET /compute/v2.1/servers/397a9d6e-2200-46c1-8e47-26aa9d406ab3 => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:18:31.560357 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-82d46e36-393c-421a-93f1-13226a445f56 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:18:31.561088 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-82d46e36-393c-421a-93f1-13226a445f56 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: 397a9d6e-2200-46c1-8e47-26aa9d406ab3] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:18:31.568466 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-82d46e36-393c-421a-93f1-13226a445f56 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:18:31.568956 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-82d46e36-393c-421a-93f1-13226a445f56 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:18:31.569393 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-82d46e36-393c-421a-93f1-13226a445f56 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:18:31.570154 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-82d46e36-393c-421a-93f1-13226a445f56 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:18:31.570614 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-82d46e36-393c-421a-93f1-13226a445f56 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:18:31.571045 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-82d46e36-393c-421a-93f1-13226a445f56 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:18:31.750946 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-82d46e36-393c-421a-93f1-13226a445f56 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:18:31.759794 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-82d46e36-393c-421a-93f1-13226a445f56 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/397a9d6e-2200-46c1-8e47-26aa9d406ab3" status: 200 len: 1265 microversion: 2.1 time: 0.203344 Sep 01 14:18:31.760386 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 597/1190] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:18:31 2022] GET /compute/v2.1/servers/397a9d6e-2200-46c1-8e47-26aa9d406ab3 => generated 1265 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:18:32.781301 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-25a839f4-c26a-4378-b020-58bb7c2abca4 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:18:32.781953 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-25a839f4-c26a-4378-b020-58bb7c2abca4 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: 397a9d6e-2200-46c1-8e47-26aa9d406ab3] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:18:32.789195 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-25a839f4-c26a-4378-b020-58bb7c2abca4 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:18:32.789692 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-25a839f4-c26a-4378-b020-58bb7c2abca4 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:18:32.790161 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-25a839f4-c26a-4378-b020-58bb7c2abca4 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:18:32.790872 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-25a839f4-c26a-4378-b020-58bb7c2abca4 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:18:32.791331 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-25a839f4-c26a-4378-b020-58bb7c2abca4 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:18:32.791754 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-25a839f4-c26a-4378-b020-58bb7c2abca4 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:18:32.943728 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-25a839f4-c26a-4378-b020-58bb7c2abca4 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:18:32.955702 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-25a839f4-c26a-4378-b020-58bb7c2abca4 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/397a9d6e-2200-46c1-8e47-26aa9d406ab3" status: 200 len: 1265 microversion: 2.1 time: 0.177974 Sep 01 14:18:32.957053 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 594/1191] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:18:32 2022] GET /compute/v2.1/servers/397a9d6e-2200-46c1-8e47-26aa9d406ab3 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:18:33.978051 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-0ff8f47a-2109-43ae-9c54-7dfaae6961e1 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:18:33.978718 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-0ff8f47a-2109-43ae-9c54-7dfaae6961e1 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: 397a9d6e-2200-46c1-8e47-26aa9d406ab3] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:18:33.981259 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell0:SELECT=2 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:18:33.981974 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell0:SELECT=6 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:18:33.986926 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0ff8f47a-2109-43ae-9c54-7dfaae6961e1 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:18:33.988089 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0ff8f47a-2109-43ae-9c54-7dfaae6961e1 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:18:33.988533 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0ff8f47a-2109-43ae-9c54-7dfaae6961e1 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:18:33.989354 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0ff8f47a-2109-43ae-9c54-7dfaae6961e1 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:18:33.989973 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0ff8f47a-2109-43ae-9c54-7dfaae6961e1 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:18:33.990517 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-0ff8f47a-2109-43ae-9c54-7dfaae6961e1 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:18:34.161394 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-0ff8f47a-2109-43ae-9c54-7dfaae6961e1 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:18:34.170202 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-0ff8f47a-2109-43ae-9c54-7dfaae6961e1 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/397a9d6e-2200-46c1-8e47-26aa9d406ab3" status: 200 len: 1265 microversion: 2.1 time: 0.196153 Sep 01 14:18:34.170795 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 598/1192] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:18:33 2022] GET /compute/v2.1/servers/397a9d6e-2200-46c1-8e47-26aa9d406ab3 => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:18:35.194670 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-1c632766-445d-476e-8685-53a6f0a67505 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:18:35.195553 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-1c632766-445d-476e-8685-53a6f0a67505 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: 397a9d6e-2200-46c1-8e47-26aa9d406ab3] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:18:35.198546 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell0:SELECT=2 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:18:35.206063 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1c632766-445d-476e-8685-53a6f0a67505 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:18:35.208711 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1c632766-445d-476e-8685-53a6f0a67505 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:18:35.208711 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1c632766-445d-476e-8685-53a6f0a67505 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:18:35.208711 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1c632766-445d-476e-8685-53a6f0a67505 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:18:35.208711 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1c632766-445d-476e-8685-53a6f0a67505 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:18:35.209260 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1c632766-445d-476e-8685-53a6f0a67505 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:18:35.387662 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-1c632766-445d-476e-8685-53a6f0a67505 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:18:35.396561 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-1c632766-445d-476e-8685-53a6f0a67505 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/397a9d6e-2200-46c1-8e47-26aa9d406ab3" status: 200 len: 1265 microversion: 2.1 time: 0.207220 Sep 01 14:18:35.397193 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 595/1193] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:18:35 2022] GET /compute/v2.1/servers/397a9d6e-2200-46c1-8e47-26aa9d406ab3 => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:18:36.418355 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-f036cb3f-13f6-4bf0-a370-5ab2273a0bca tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:18:36.419035 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-f036cb3f-13f6-4bf0-a370-5ab2273a0bca tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: 397a9d6e-2200-46c1-8e47-26aa9d406ab3] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:18:36.426531 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f036cb3f-13f6-4bf0-a370-5ab2273a0bca tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:18:36.427028 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f036cb3f-13f6-4bf0-a370-5ab2273a0bca tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:18:36.427470 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f036cb3f-13f6-4bf0-a370-5ab2273a0bca tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:18:36.428188 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f036cb3f-13f6-4bf0-a370-5ab2273a0bca tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:18:36.428647 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f036cb3f-13f6-4bf0-a370-5ab2273a0bca tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:18:36.429084 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f036cb3f-13f6-4bf0-a370-5ab2273a0bca tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:18:36.610914 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-f036cb3f-13f6-4bf0-a370-5ab2273a0bca tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:18:36.619765 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-f036cb3f-13f6-4bf0-a370-5ab2273a0bca tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/397a9d6e-2200-46c1-8e47-26aa9d406ab3" status: 200 len: 1265 microversion: 2.1 time: 0.205581 Sep 01 14:18:36.620356 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 599/1194] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:18:36 2022] GET /compute/v2.1/servers/397a9d6e-2200-46c1-8e47-26aa9d406ab3 => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:18:37.641749 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-1e58a781-3a4b-4fb4-b1f6-c6c308d06239 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:18:37.642586 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-1e58a781-3a4b-4fb4-b1f6-c6c308d06239 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: 397a9d6e-2200-46c1-8e47-26aa9d406ab3] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:18:37.651190 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1e58a781-3a4b-4fb4-b1f6-c6c308d06239 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:18:37.652246 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1e58a781-3a4b-4fb4-b1f6-c6c308d06239 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:18:37.652950 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1e58a781-3a4b-4fb4-b1f6-c6c308d06239 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:18:37.653880 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1e58a781-3a4b-4fb4-b1f6-c6c308d06239 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:18:37.654556 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1e58a781-3a4b-4fb4-b1f6-c6c308d06239 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:18:37.655119 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-1e58a781-3a4b-4fb4-b1f6-c6c308d06239 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:18:37.841064 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-1e58a781-3a4b-4fb4-b1f6-c6c308d06239 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:18:37.850680 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-1e58a781-3a4b-4fb4-b1f6-c6c308d06239 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/397a9d6e-2200-46c1-8e47-26aa9d406ab3" status: 200 len: 1265 microversion: 2.1 time: 0.213183 Sep 01 14:18:37.851279 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 596/1195] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:18:37 2022] GET /compute/v2.1/servers/397a9d6e-2200-46c1-8e47-26aa9d406ab3 => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:18:38.872378 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-6612d857-aac3-4714-bfa9-482ef72e1574 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:18:38.873092 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-6612d857-aac3-4714-bfa9-482ef72e1574 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: 397a9d6e-2200-46c1-8e47-26aa9d406ab3] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:18:38.881706 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6612d857-aac3-4714-bfa9-482ef72e1574 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:18:38.882236 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6612d857-aac3-4714-bfa9-482ef72e1574 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:18:38.882674 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6612d857-aac3-4714-bfa9-482ef72e1574 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:18:38.883398 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6612d857-aac3-4714-bfa9-482ef72e1574 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:18:38.883888 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6612d857-aac3-4714-bfa9-482ef72e1574 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:18:38.884321 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-6612d857-aac3-4714-bfa9-482ef72e1574 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:18:39.092652 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-6612d857-aac3-4714-bfa9-482ef72e1574 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:18:39.107568 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-6612d857-aac3-4714-bfa9-482ef72e1574 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/397a9d6e-2200-46c1-8e47-26aa9d406ab3" status: 200 len: 1265 microversion: 2.1 time: 0.238850 Sep 01 14:18:39.108613 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 600/1196] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:18:38 2022] GET /compute/v2.1/servers/397a9d6e-2200-46c1-8e47-26aa9d406ab3 => generated 1265 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:18:39.476598 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [req-fdd862b1-8273-48ed-ac46-443b7e615f0f req-edf5fde5-36e2-402e-b0dd-a4134c60f18b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "397a9d6e-2200-46c1-8e47-26aa9d406ab3", "name": "network-vif-plugged", "status": "completed", "tag": "eecd28cb-3ec6-44bb-9bad-77c2c70db92a"}]} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:18:39.487614 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-fdd862b1-8273-48ed-ac46-443b7e615f0f req-edf5fde5-36e2-402e-b0dd-a4134c60f18b service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:18:39.488518 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-fdd862b1-8273-48ed-ac46-443b7e615f0f req-edf5fde5-36e2-402e-b0dd-a4134c60f18b service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:18:39.489185 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-fdd862b1-8273-48ed-ac46-443b7e615f0f req-edf5fde5-36e2-402e-b0dd-a4134c60f18b service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:18:39.502454 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.compute.server_external_events [req-fdd862b1-8273-48ed-ac46-443b7e615f0f req-edf5fde5-36e2-402e-b0dd-a4134c60f18b service nova] Creating event network-vif-plugged:eecd28cb-3ec6-44bb-9bad-77c2c70db92a for instance 397a9d6e-2200-46c1-8e47-26aa9d406ab3 on hv-cinder-85221 Sep 01 14:18:39.509259 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [req-fdd862b1-8273-48ed-ac46-443b7e615f0f req-edf5fde5-36e2-402e-b0dd-a4134c60f18b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.246216 Sep 01 14:18:39.509973 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 597/1197] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:18:40.130341 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-a2043ceb-dbdb-482b-85fe-c39b2a55aca0 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:18:40.131192 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-a2043ceb-dbdb-482b-85fe-c39b2a55aca0 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: 397a9d6e-2200-46c1-8e47-26aa9d406ab3] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:18:40.138977 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a2043ceb-dbdb-482b-85fe-c39b2a55aca0 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:18:40.139593 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a2043ceb-dbdb-482b-85fe-c39b2a55aca0 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:18:40.140031 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a2043ceb-dbdb-482b-85fe-c39b2a55aca0 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:18:40.140762 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a2043ceb-dbdb-482b-85fe-c39b2a55aca0 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:18:40.141385 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a2043ceb-dbdb-482b-85fe-c39b2a55aca0 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:18:40.141833 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-a2043ceb-dbdb-482b-85fe-c39b2a55aca0 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:18:40.355124 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-a2043ceb-dbdb-482b-85fe-c39b2a55aca0 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:18:40.365245 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-a2043ceb-dbdb-482b-85fe-c39b2a55aca0 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/397a9d6e-2200-46c1-8e47-26aa9d406ab3" status: 200 len: 1265 microversion: 2.1 time: 0.238911 Sep 01 14:18:40.365847 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 601/1198] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:18:40 2022] GET /compute/v2.1/servers/397a9d6e-2200-46c1-8e47-26aa9d406ab3 => generated 1265 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:18:41.389163 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-9b5009d0-ed26-4ba2-9e96-427bb6c40895 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:18:41.390051 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-9b5009d0-ed26-4ba2-9e96-427bb6c40895 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: 397a9d6e-2200-46c1-8e47-26aa9d406ab3] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:18:41.397638 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9b5009d0-ed26-4ba2-9e96-427bb6c40895 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:18:41.398172 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9b5009d0-ed26-4ba2-9e96-427bb6c40895 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:18:41.398609 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9b5009d0-ed26-4ba2-9e96-427bb6c40895 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:18:41.399326 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9b5009d0-ed26-4ba2-9e96-427bb6c40895 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:18:41.399786 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9b5009d0-ed26-4ba2-9e96-427bb6c40895 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:18:41.400240 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-9b5009d0-ed26-4ba2-9e96-427bb6c40895 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:18:41.561490 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-9b5009d0-ed26-4ba2-9e96-427bb6c40895 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:18:41.576501 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-9b5009d0-ed26-4ba2-9e96-427bb6c40895 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/397a9d6e-2200-46c1-8e47-26aa9d406ab3" status: 200 len: 1265 microversion: 2.1 time: 0.191607 Sep 01 14:18:41.583870 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 598/1199] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:18:41 2022] GET /compute/v2.1/servers/397a9d6e-2200-46c1-8e47-26aa9d406ab3 => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:18:42.615031 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-229db49c-21b9-4611-9f7b-217870397455 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:18:42.616194 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-229db49c-21b9-4611-9f7b-217870397455 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: 397a9d6e-2200-46c1-8e47-26aa9d406ab3] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:18:42.633164 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-229db49c-21b9-4611-9f7b-217870397455 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:18:42.634959 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-229db49c-21b9-4611-9f7b-217870397455 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:18:42.635100 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-229db49c-21b9-4611-9f7b-217870397455 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:18:42.636271 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-229db49c-21b9-4611-9f7b-217870397455 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:18:42.637147 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-229db49c-21b9-4611-9f7b-217870397455 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:18:42.637993 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-229db49c-21b9-4611-9f7b-217870397455 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:18:42.795950 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-229db49c-21b9-4611-9f7b-217870397455 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:18:42.805562 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-229db49c-21b9-4611-9f7b-217870397455 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/397a9d6e-2200-46c1-8e47-26aa9d406ab3" status: 200 len: 1452 microversion: 2.1 time: 0.197918 Sep 01 14:18:42.806118 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 602/1200] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:18:42 2022] GET /compute/v2.1/servers/397a9d6e-2200-46c1-8e47-26aa9d406ab3 => generated 1452 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:18:42.827348 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-e2254e14-fe7b-4325-8a90-e5f9acb8c637 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:18:42.827986 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-e2254e14-fe7b-4325-8a90-e5f9acb8c637 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: 397a9d6e-2200-46c1-8e47-26aa9d406ab3] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:18:42.836270 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e2254e14-fe7b-4325-8a90-e5f9acb8c637 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:18:42.836762 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e2254e14-fe7b-4325-8a90-e5f9acb8c637 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:18:42.837204 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e2254e14-fe7b-4325-8a90-e5f9acb8c637 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:18:42.837995 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e2254e14-fe7b-4325-8a90-e5f9acb8c637 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:18:42.838602 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e2254e14-fe7b-4325-8a90-e5f9acb8c637 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:18:42.838989 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-e2254e14-fe7b-4325-8a90-e5f9acb8c637 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:18:43.020124 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-e2254e14-fe7b-4325-8a90-e5f9acb8c637 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:18:43.028583 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-e2254e14-fe7b-4325-8a90-e5f9acb8c637 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/397a9d6e-2200-46c1-8e47-26aa9d406ab3" status: 200 len: 1452 microversion: 2.1 time: 0.205376 Sep 01 14:18:43.029163 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 599/1201] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:18:42 2022] GET /compute/v2.1/servers/397a9d6e-2200-46c1-8e47-26aa9d406ab3 => generated 1452 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:18:45.616361 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [req-a20c05ed-350a-40dc-afee-de6d720b1611 req-9894505b-f631-4359-99b0-7abc05aa9b71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "397a9d6e-2200-46c1-8e47-26aa9d406ab3", "tag": "eecd28cb-3ec6-44bb-9bad-77c2c70db92a"}]} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:18:45.628485 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-a20c05ed-350a-40dc-afee-de6d720b1611 req-9894505b-f631-4359-99b0-7abc05aa9b71 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:18:45.629056 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-a20c05ed-350a-40dc-afee-de6d720b1611 req-9894505b-f631-4359-99b0-7abc05aa9b71 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:18:45.629554 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-a20c05ed-350a-40dc-afee-de6d720b1611 req-9894505b-f631-4359-99b0-7abc05aa9b71 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:18:45.643014 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.compute.server_external_events [req-a20c05ed-350a-40dc-afee-de6d720b1611 req-9894505b-f631-4359-99b0-7abc05aa9b71 service nova] Creating event network-changed:eecd28cb-3ec6-44bb-9bad-77c2c70db92a for instance 397a9d6e-2200-46c1-8e47-26aa9d406ab3 on hv-cinder-85221 Sep 01 14:18:45.649397 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [req-a20c05ed-350a-40dc-afee-de6d720b1611 req-9894505b-f631-4359-99b0-7abc05aa9b71 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120904 Sep 01 14:18:45.650076 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 603/1202] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:20:17.736389 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:20:17.737655 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG dbcounter [-] [121340] Writing DB stats nova_cell1:SELECT=58 {{(pid=121340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:20:17.738229 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-b3dc7292-a4c4-4755-a021-2272076f2247 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:20:17.738962 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-b3dc7292-a4c4-4755-a021-2272076f2247 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: 397a9d6e-2200-46c1-8e47-26aa9d406ab3] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:20:17.741552 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3486efaa-bcbb-499b-9182-e41861e4892b] AMQP server on 10.222.0.25:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 01 14:20:17.742192 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_api:SELECT=22 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:20:17.742929 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG dbcounter [-] [121339] Writing DB stats nova_cell1:SELECT=46 {{(pid=121339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:20:17.744035 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 14:20:17.744035 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Thu Sep 1 14:20:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/397a9d6e-2200-46c1-8e47-26aa9d406ab3 (ip 10.222.0.25) !!! Sep 01 14:20:17.746385 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [req-3b3b5c55-eed7-43b2-82a2-a425bc9ef15d req-1707161b-3d33-44d1-bfbb-63eb03bf7ad0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "397a9d6e-2200-46c1-8e47-26aa9d406ab3", "tag": "eecd28cb-3ec6-44bb-9bad-77c2c70db92a"}]} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:20:17.760485 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b3dc7292-a4c4-4755-a021-2272076f2247 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:20:17.761036 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b3dc7292-a4c4-4755-a021-2272076f2247 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:20:17.761424 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b3dc7292-a4c4-4755-a021-2272076f2247 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:20:17.762190 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b3dc7292-a4c4-4755-a021-2272076f2247 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:20:17.762643 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-3b3b5c55-eed7-43b2-82a2-a425bc9ef15d req-1707161b-3d33-44d1-bfbb-63eb03bf7ad0 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:20:17.762865 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b3dc7292-a4c4-4755-a021-2272076f2247 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:20:17.763060 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-b3dc7292-a4c4-4755-a021-2272076f2247 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:20:17.763476 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-3b3b5c55-eed7-43b2-82a2-a425bc9ef15d req-1707161b-3d33-44d1-bfbb-63eb03bf7ad0 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:20:17.764975 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-3b3b5c55-eed7-43b2-82a2-a425bc9ef15d req-1707161b-3d33-44d1-bfbb-63eb03bf7ad0 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:20:17.781305 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.compute.server_external_events [req-3b3b5c55-eed7-43b2-82a2-a425bc9ef15d req-1707161b-3d33-44d1-bfbb-63eb03bf7ad0 service nova] Creating event network-changed:eecd28cb-3ec6-44bb-9bad-77c2c70db92a for instance 397a9d6e-2200-46c1-8e47-26aa9d406ab3 on hv-cinder-85221 Sep 01 14:20:17.788863 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [req-3b3b5c55-eed7-43b2-82a2-a425bc9ef15d req-1707161b-3d33-44d1-bfbb-63eb03bf7ad0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056335 Sep 01 14:20:17.789714 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 604/1203] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:20:17.800425 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-b3dc7292-a4c4-4755-a021-2272076f2247 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: 397a9d6e-2200-46c1-8e47-26aa9d406ab3] Going to try to terminate instance {{(pid=121339) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:20:18.171272 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-b3dc7292-a4c4-4755-a021-2272076f2247 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "DELETE /compute/v2.1/servers/397a9d6e-2200-46c1-8e47-26aa9d406ab3" status: 204 len: 0 microversion: 2.1 time: 0.441037 Sep 01 14:20:18.172259 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 600/1204] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 14:20:17 2022] DELETE /compute/v2.1/servers/397a9d6e-2200-46c1-8e47-26aa9d406ab3 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:20:18.189087 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-b9eafb36-8b64-4f79-9375-50238a76231c tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:20:18.190501 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-b9eafb36-8b64-4f79-9375-50238a76231c tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: 397a9d6e-2200-46c1-8e47-26aa9d406ab3] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:20:18.199924 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b9eafb36-8b64-4f79-9375-50238a76231c tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:20:18.200546 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b9eafb36-8b64-4f79-9375-50238a76231c tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:20:18.201057 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b9eafb36-8b64-4f79-9375-50238a76231c tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:20:18.202773 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b9eafb36-8b64-4f79-9375-50238a76231c tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:20:18.207785 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b9eafb36-8b64-4f79-9375-50238a76231c tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:20:18.207785 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b9eafb36-8b64-4f79-9375-50238a76231c tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:20:18.402137 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-b9eafb36-8b64-4f79-9375-50238a76231c tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:20:18.413363 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-b9eafb36-8b64-4f79-9375-50238a76231c tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/397a9d6e-2200-46c1-8e47-26aa9d406ab3" status: 200 len: 1576 microversion: 2.1 time: 0.233958 Sep 01 14:20:18.414155 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 605/1205] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:20:18 2022] GET /compute/v2.1/servers/397a9d6e-2200-46c1-8e47-26aa9d406ab3 => generated 1576 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:20:19.453446 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-17d71a76-6fc1-4f90-b4bd-25e55cf21d21 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:20:19.454510 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-17d71a76-6fc1-4f90-b4bd-25e55cf21d21 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: 397a9d6e-2200-46c1-8e47-26aa9d406ab3] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:20:19.468723 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-17d71a76-6fc1-4f90-b4bd-25e55cf21d21 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:20:19.469381 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-17d71a76-6fc1-4f90-b4bd-25e55cf21d21 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:20:19.469946 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-17d71a76-6fc1-4f90-b4bd-25e55cf21d21 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:20:19.470856 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-17d71a76-6fc1-4f90-b4bd-25e55cf21d21 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:20:19.471548 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-17d71a76-6fc1-4f90-b4bd-25e55cf21d21 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:20:19.472025 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-17d71a76-6fc1-4f90-b4bd-25e55cf21d21 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:20:19.491675 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO oslo.messaging._drivers.impl_rabbit [-] [3486efaa-bcbb-499b-9182-e41861e4892b] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 60106. Sep 01 14:20:19.655368 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-17d71a76-6fc1-4f90-b4bd-25e55cf21d21 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:20:19.663693 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-17d71a76-6fc1-4f90-b4bd-25e55cf21d21 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/397a9d6e-2200-46c1-8e47-26aa9d406ab3" status: 200 len: 1576 microversion: 2.1 time: 0.218954 Sep 01 14:20:19.664260 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 601/1206] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:20:19 2022] GET /compute/v2.1/servers/397a9d6e-2200-46c1-8e47-26aa9d406ab3 => generated 1576 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:20:20.335817 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [req-58175f94-f5ad-48c6-bafa-11ffc874a423 req-e35c0d1e-fc30-44a5-98ec-bf4dc36373f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "397a9d6e-2200-46c1-8e47-26aa9d406ab3", "name": "network-vif-deleted", "tag": "eecd28cb-3ec6-44bb-9bad-77c2c70db92a"}]} {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:20:20.351418 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-58175f94-f5ad-48c6-bafa-11ffc874a423 req-e35c0d1e-fc30-44a5-98ec-bf4dc36373f2 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:20:20.351863 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-58175f94-f5ad-48c6-bafa-11ffc874a423 req-e35c0d1e-fc30-44a5-98ec-bf4dc36373f2 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:20:20.352478 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [req-58175f94-f5ad-48c6-bafa-11ffc874a423 req-e35c0d1e-fc30-44a5-98ec-bf4dc36373f2 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:20:20.366813 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.compute.server_external_events [req-58175f94-f5ad-48c6-bafa-11ffc874a423 req-e35c0d1e-fc30-44a5-98ec-bf4dc36373f2 service nova] Creating event network-vif-deleted:eecd28cb-3ec6-44bb-9bad-77c2c70db92a for instance 397a9d6e-2200-46c1-8e47-26aa9d406ab3 on hv-cinder-85221 Sep 01 14:20:20.372684 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [req-58175f94-f5ad-48c6-bafa-11ffc874a423 req-e35c0d1e-fc30-44a5-98ec-bf4dc36373f2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043750 Sep 01 14:20:20.373655 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 606/1207] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:20:20.689549 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-02b0b3d4-5221-4330-aa37-0693a9b5f0c7 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:20:20.690706 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-02b0b3d4-5221-4330-aa37-0693a9b5f0c7 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: 397a9d6e-2200-46c1-8e47-26aa9d406ab3] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:20:20.703499 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-02b0b3d4-5221-4330-aa37-0693a9b5f0c7 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:20:20.704343 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-02b0b3d4-5221-4330-aa37-0693a9b5f0c7 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:20:20.705100 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-02b0b3d4-5221-4330-aa37-0693a9b5f0c7 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:20:20.706756 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-02b0b3d4-5221-4330-aa37-0693a9b5f0c7 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:20:20.707863 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-02b0b3d4-5221-4330-aa37-0693a9b5f0c7 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:20:20.708517 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-02b0b3d4-5221-4330-aa37-0693a9b5f0c7 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:20:20.809066 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-02b0b3d4-5221-4330-aa37-0693a9b5f0c7 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:20:20.818643 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-02b0b3d4-5221-4330-aa37-0693a9b5f0c7 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/397a9d6e-2200-46c1-8e47-26aa9d406ab3" status: 200 len: 1225 microversion: 2.1 time: 0.136033 Sep 01 14:20:20.819401 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 602/1208] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:20:20 2022] GET /compute/v2.1/servers/397a9d6e-2200-46c1-8e47-26aa9d406ab3 => generated 1225 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:20:21.842556 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-e97dbf44-1098-44e5-a0f5-9b2847e7cbef tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:20:21.843385 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-e97dbf44-1098-44e5-a0f5-9b2847e7cbef tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: 397a9d6e-2200-46c1-8e47-26aa9d406ab3] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:20:21.850383 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e97dbf44-1098-44e5-a0f5-9b2847e7cbef tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:20:21.850875 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e97dbf44-1098-44e5-a0f5-9b2847e7cbef tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:20:21.851306 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e97dbf44-1098-44e5-a0f5-9b2847e7cbef tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:20:21.852016 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e97dbf44-1098-44e5-a0f5-9b2847e7cbef tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:20:21.852465 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e97dbf44-1098-44e5-a0f5-9b2847e7cbef tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:20:21.852952 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e97dbf44-1098-44e5-a0f5-9b2847e7cbef tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:20:21.888808 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e97dbf44-1098-44e5-a0f5-9b2847e7cbef tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:20:21.889957 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e97dbf44-1098-44e5-a0f5-9b2847e7cbef tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:20:21.890490 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-e97dbf44-1098-44e5-a0f5-9b2847e7cbef tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:20:21.890997 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.objects.instance [None req-e97dbf44-1098-44e5-a0f5-9b2847e7cbef tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lazy-loading 'fault' on Instance uuid 397a9d6e-2200-46c1-8e47-26aa9d406ab3 {{(pid=121340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:20:21.943498 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-e97dbf44-1098-44e5-a0f5-9b2847e7cbef tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:20:21.952036 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-e97dbf44-1098-44e5-a0f5-9b2847e7cbef tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/397a9d6e-2200-46c1-8e47-26aa9d406ab3" status: 200 len: 1184 microversion: 2.1 time: 0.114694 Sep 01 14:20:21.955297 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 607/1209] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:20:21 2022] GET /compute/v2.1/servers/397a9d6e-2200-46c1-8e47-26aa9d406ab3 => generated 1184 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:20:22.973841 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-5aa9c64c-792d-4121-b219-ff02fd76b61b tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:20:22.974491 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-5aa9c64c-792d-4121-b219-ff02fd76b61b tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: 397a9d6e-2200-46c1-8e47-26aa9d406ab3] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:20:22.981857 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5aa9c64c-792d-4121-b219-ff02fd76b61b tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:20:22.982396 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5aa9c64c-792d-4121-b219-ff02fd76b61b tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:20:22.982838 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5aa9c64c-792d-4121-b219-ff02fd76b61b tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:20:22.983571 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5aa9c64c-792d-4121-b219-ff02fd76b61b tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:20:22.984170 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5aa9c64c-792d-4121-b219-ff02fd76b61b tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:20:22.984602 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-5aa9c64c-792d-4121-b219-ff02fd76b61b tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:20:22.999565 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.wsgi [None req-5aa9c64c-792d-4121-b219-ff02fd76b61b tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] HTTP exception thrown: Instance 397a9d6e-2200-46c1-8e47-26aa9d406ab3 could not be found. Sep 01 14:20:23.001312 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-5aa9c64c-792d-4121-b219-ff02fd76b61b tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Request method failure captured: Sep 01 14:20:23.001312 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: request: GET /compute/v2.1/servers/397a9d6e-2200-46c1-8e47-26aa9d406ab3 HTTP/1.1 Sep 01 14:20:23.001312 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept: application/json Sep 01 14:20:23.001312 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept-Encoding: identity Sep 01 14:20:23.001312 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Connection: close Sep 01 14:20:23.001312 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Length: 0 Sep 01 14:20:23.001312 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Type: application/json Sep 01 14:20:23.001312 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Host: 10.222.0.25 Sep 01 14:20:23.001312 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Openstack-System-Scope: None Sep 01 14:20:23.001312 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: User-Agent: python-urllib3/1.26.12 Sep 01 14:20:23.001312 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Auth-Token: gAAAAABjEL3NOrxJYijbJSOMZMLZzZSVPHyAdl_Bm2Q9EKvB6aWvFJhgq4XisE3tQ1CJ0eLS1f3ZaMz1-2KlOZ5qeLsAV5fmAZJmiV4-9A-IotFZOfK4CGwgPA9xha4GJ_b5LDPIkmmB5fUTtMCqvypE0Q1RYsFekKspBEpjT9EUqbzEyw-7SOw Sep 01 14:20:23.001312 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Id: None Sep 01 14:20:23.001312 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Name: None Sep 01 14:20:23.001312 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Identity-Status: Confirmed Sep 01 14:20:23.001312 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Is-Admin-Project: True Sep 01 14:20:23.001312 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Id: default Sep 01 14:20:23.001312 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Name: Default Sep 01 14:20:23.001312 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Id: 8acdb976501045c0813d16f3d0ffd13d Sep 01 14:20:23.001312 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Name: tempest-TestVolumeBootPattern-657955642 Sep 01 14:20:23.001312 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Role: member,reader Sep 01 14:20:23.001312 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Roles: member,reader Sep 01 14:20:23.004107 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8acdb976501045c0813d16f3d0ffd13d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8acdb976501045c0813d16f3d0ffd13d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8acdb976501045c0813d16f3d0ffd13d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8acdb976501045c0813d16f3d0ffd13d"}]}] Sep 01 14:20:23.004107 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant: tempest-TestVolumeBootPattern-657955642 Sep 01 14:20:23.004107 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Id: 8acdb976501045c0813d16f3d0ffd13d Sep 01 14:20:23.004107 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Name: tempest-TestVolumeBootPattern-657955642 Sep 01 14:20:23.004107 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User: tempest-TestVolumeBootPattern-657955642-project Sep 01 14:20:23.004107 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Id: default Sep 01 14:20:23.004107 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Name: Default Sep 01 14:20:23.004107 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Id: 93f843d15d194f0b9f44ec33c49b9b4c Sep 01 14:20:23.004107 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Name: tempest-TestVolumeBootPattern-657955642-project Sep 01 14:20:23.004107 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: method: > Sep 01 14:20:23.004107 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: exception: Instance 397a9d6e-2200-46c1-8e47-26aa9d406ab3 could not be found. Sep 01 14:20:23.004107 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: action_args: {'id': '397a9d6e-2200-46c1-8e47-26aa9d406ab3'} Sep 01 14:20:23.005549 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:20:23.005549 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:20:23.005549 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:20:23.005549 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:20:23.005549 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:20:23.005549 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:20:23.005549 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:20:23.005549 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:20:23.005549 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:20:23.005549 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:20:23.005549 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 397a9d6e-2200-46c1-8e47-26aa9d406ab3 could not be found. Sep 01 14:20:23.005549 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:20:23.005549 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:20:23.005549 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:20:23.005549 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:20:23.005549 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:20:23.005549 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:20:23.005549 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:20:23.005549 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:20:23.005549 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:20:23.008113 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:20:23.008113 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:20:23.008113 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:20:23.008113 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:20:23.008113 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:20:23.008113 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:20:23.008113 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:20:23.008113 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 397a9d6e-2200-46c1-8e47-26aa9d406ab3 could not be found. Sep 01 14:20:23.008113 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:20:23.008113 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:20:23.008113 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:20:23.008113 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:20:23.008113 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:20:23.008113 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:20:23.008113 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:20:23.008113 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:20:23.008113 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 397a9d6e-2200-46c1-8e47-26aa9d406ab3 could not be found. Sep 01 14:20:23.008113 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:20:23.010482 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-5aa9c64c-792d-4121-b219-ff02fd76b61b tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Returning 404 to user: Instance 397a9d6e-2200-46c1-8e47-26aa9d406ab3 could not be found. {{(pid=121339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:20:23.010482 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-5aa9c64c-792d-4121-b219-ff02fd76b61b tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/397a9d6e-2200-46c1-8e47-26aa9d406ab3" status: 404 len: 111 microversion: 2.1 time: 0.033064 Sep 01 14:20:23.010482 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 603/1210] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:20:22 2022] GET /compute/v2.1/servers/397a9d6e-2200-46c1-8e47-26aa9d406ab3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 14:20:26.883390 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-f25d0622-c535-4f69-8d9c-c8a4c50d197a tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:20:26.884275 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-f25d0622-c535-4f69-8d9c-c8a4c50d197a tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: da103289-634e-420f-9750-b36e4d00c641] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:20:26.884447 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [req-32f0739d-a032-4fee-a60c-e315b5cb7776 req-ee2c903d-cdf6-4480-b1ca-9e9e8d7cdfd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da103289-634e-420f-9750-b36e4d00c641", "tag": "a35baeba-2fc3-441f-b089-15255aad1de1"}]} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:20:26.894536 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f25d0622-c535-4f69-8d9c-c8a4c50d197a tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:20:26.895302 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f25d0622-c535-4f69-8d9c-c8a4c50d197a tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:20:26.896068 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f25d0622-c535-4f69-8d9c-c8a4c50d197a tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:20:26.897109 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f25d0622-c535-4f69-8d9c-c8a4c50d197a tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:20:26.897327 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-32f0739d-a032-4fee-a60c-e315b5cb7776 req-ee2c903d-cdf6-4480-b1ca-9e9e8d7cdfd8 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:20:26.897816 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-32f0739d-a032-4fee-a60c-e315b5cb7776 req-ee2c903d-cdf6-4480-b1ca-9e9e8d7cdfd8 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:20:26.898077 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f25d0622-c535-4f69-8d9c-c8a4c50d197a tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:20:26.898298 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-32f0739d-a032-4fee-a60c-e315b5cb7776 req-ee2c903d-cdf6-4480-b1ca-9e9e8d7cdfd8 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:20:26.898624 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-f25d0622-c535-4f69-8d9c-c8a4c50d197a tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:20:26.918373 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.compute.server_external_events [req-32f0739d-a032-4fee-a60c-e315b5cb7776 req-ee2c903d-cdf6-4480-b1ca-9e9e8d7cdfd8 service nova] Creating event network-changed:a35baeba-2fc3-441f-b089-15255aad1de1 for instance da103289-634e-420f-9750-b36e4d00c641 on hv-cinder-85221 Sep 01 14:20:26.927534 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [req-32f0739d-a032-4fee-a60c-e315b5cb7776 req-ee2c903d-cdf6-4480-b1ca-9e9e8d7cdfd8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046794 Sep 01 14:20:26.929524 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 604/1211] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:20:26.950216 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-f25d0622-c535-4f69-8d9c-c8a4c50d197a tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: da103289-634e-420f-9750-b36e4d00c641] Going to try to terminate instance {{(pid=121340) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:20:27.295322 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-f25d0622-c535-4f69-8d9c-c8a4c50d197a tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "DELETE /compute/v2.1/servers/da103289-634e-420f-9750-b36e4d00c641" status: 204 len: 0 microversion: 2.1 time: 0.416395 Sep 01 14:20:27.296042 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 608/1212] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 14:20:26 2022] DELETE /compute/v2.1/servers/da103289-634e-420f-9750-b36e4d00c641 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:20:27.308864 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-d49b9d86-164a-4858-aa15-0a544befd557 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:20:27.308864 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-d49b9d86-164a-4858-aa15-0a544befd557 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: da103289-634e-420f-9750-b36e4d00c641] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:20:27.313595 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d49b9d86-164a-4858-aa15-0a544befd557 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:20:27.314140 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d49b9d86-164a-4858-aa15-0a544befd557 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:20:27.314699 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d49b9d86-164a-4858-aa15-0a544befd557 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:20:27.315560 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d49b9d86-164a-4858-aa15-0a544befd557 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:20:27.316030 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d49b9d86-164a-4858-aa15-0a544befd557 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:20:27.316461 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-d49b9d86-164a-4858-aa15-0a544befd557 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:20:27.524723 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.policy [None req-d49b9d86-164a-4858-aa15-0a544befd557 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121339) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:20:27.534955 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-d49b9d86-164a-4858-aa15-0a544befd557 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/da103289-634e-420f-9750-b36e4d00c641" status: 200 len: 1577 microversion: 2.1 time: 0.234155 Sep 01 14:20:27.535541 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 605/1213] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:20:27 2022] GET /compute/v2.1/servers/da103289-634e-420f-9750-b36e4d00c641 => generated 1577 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:20:28.572664 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-fc747375-828f-4640-b839-cf9c15799c15 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:20:28.574048 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-fc747375-828f-4640-b839-cf9c15799c15 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: da103289-634e-420f-9750-b36e4d00c641] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:20:28.584309 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-fc747375-828f-4640-b839-cf9c15799c15 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:20:28.585160 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-fc747375-828f-4640-b839-cf9c15799c15 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:20:28.585965 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-fc747375-828f-4640-b839-cf9c15799c15 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:20:28.587197 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-fc747375-828f-4640-b839-cf9c15799c15 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:20:28.588016 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-fc747375-828f-4640-b839-cf9c15799c15 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:20:28.588808 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-fc747375-828f-4640-b839-cf9c15799c15 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:20:28.751880 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-fc747375-828f-4640-b839-cf9c15799c15 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:20:28.761245 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-fc747375-828f-4640-b839-cf9c15799c15 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/da103289-634e-420f-9750-b36e4d00c641" status: 200 len: 1577 microversion: 2.1 time: 0.194335 Sep 01 14:20:28.761845 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 609/1214] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:20:28 2022] GET /compute/v2.1/servers/da103289-634e-420f-9750-b36e4d00c641 => generated 1577 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:20:29.468949 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [req-a4567bbe-4c01-4faa-812b-5651e9407ad2 req-bd51e82c-da80-4b20-a70a-368ec4069442 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da103289-634e-420f-9750-b36e4d00c641", "name": "network-vif-deleted", "tag": "a35baeba-2fc3-441f-b089-15255aad1de1"}]} {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:20:29.488385 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-a4567bbe-4c01-4faa-812b-5651e9407ad2 req-bd51e82c-da80-4b20-a70a-368ec4069442 service nova] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:20:29.495303 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-a4567bbe-4c01-4faa-812b-5651e9407ad2 req-bd51e82c-da80-4b20-a70a-368ec4069442 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:20:29.495303 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [req-a4567bbe-4c01-4faa-812b-5651e9407ad2 req-bd51e82c-da80-4b20-a70a-368ec4069442 service nova] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:20:29.512668 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.compute.server_external_events [req-a4567bbe-4c01-4faa-812b-5651e9407ad2 req-bd51e82c-da80-4b20-a70a-368ec4069442 service nova] Creating event network-vif-deleted:a35baeba-2fc3-441f-b089-15255aad1de1 for instance da103289-634e-420f-9750-b36e4d00c641 on hv-cinder-85221 Sep 01 14:20:29.522162 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [req-a4567bbe-4c01-4faa-812b-5651e9407ad2 req-bd51e82c-da80-4b20-a70a-368ec4069442 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060660 Sep 01 14:20:29.529855 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 606/1215] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 14:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:20:29.786999 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-1d74dd43-92e5-4437-9b57-25255f6570f4 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:20:29.788042 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-1d74dd43-92e5-4437-9b57-25255f6570f4 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: da103289-634e-420f-9750-b36e4d00c641] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:20:29.798090 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1d74dd43-92e5-4437-9b57-25255f6570f4 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:20:29.798657 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1d74dd43-92e5-4437-9b57-25255f6570f4 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:20:29.799222 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1d74dd43-92e5-4437-9b57-25255f6570f4 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:20:29.800479 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1d74dd43-92e5-4437-9b57-25255f6570f4 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:20:29.801315 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1d74dd43-92e5-4437-9b57-25255f6570f4 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:20:29.802109 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-1d74dd43-92e5-4437-9b57-25255f6570f4 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:20:29.913748 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.policy [None req-1d74dd43-92e5-4437-9b57-25255f6570f4 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f843d15d194f0b9f44ec33c49b9b4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8acdb976501045c0813d16f3d0ffd13d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121340) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:20:29.924948 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-1d74dd43-92e5-4437-9b57-25255f6570f4 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/da103289-634e-420f-9750-b36e4d00c641" status: 200 len: 1225 microversion: 2.1 time: 0.144306 Sep 01 14:20:29.925780 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 610/1216] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:20:29 2022] GET /compute/v2.1/servers/da103289-634e-420f-9750-b36e4d00c641 => generated 1225 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:20:30.949890 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-fe98cc95-590e-4117-bd70-c1c4d784d51d tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:20:30.950744 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-fe98cc95-590e-4117-bd70-c1c4d784d51d tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: da103289-634e-420f-9750-b36e4d00c641] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:20:30.960987 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fe98cc95-590e-4117-bd70-c1c4d784d51d tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:20:30.961915 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fe98cc95-590e-4117-bd70-c1c4d784d51d tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:20:30.962937 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fe98cc95-590e-4117-bd70-c1c4d784d51d tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:20:30.964293 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fe98cc95-590e-4117-bd70-c1c4d784d51d tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:20:30.965136 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fe98cc95-590e-4117-bd70-c1c4d784d51d tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:20:30.965931 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-fe98cc95-590e-4117-bd70-c1c4d784d51d tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:20:30.993217 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.wsgi [None req-fe98cc95-590e-4117-bd70-c1c4d784d51d tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] HTTP exception thrown: Instance da103289-634e-420f-9750-b36e4d00c641 could not be found. Sep 01 14:20:30.996343 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-fe98cc95-590e-4117-bd70-c1c4d784d51d tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Request method failure captured: Sep 01 14:20:30.996343 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: request: GET /compute/v2.1/servers/da103289-634e-420f-9750-b36e4d00c641 HTTP/1.1 Sep 01 14:20:30.996343 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept: application/json Sep 01 14:20:30.996343 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept-Encoding: identity Sep 01 14:20:30.996343 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Connection: close Sep 01 14:20:30.996343 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Length: 0 Sep 01 14:20:30.996343 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Type: application/json Sep 01 14:20:30.996343 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Host: 10.222.0.25 Sep 01 14:20:30.996343 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Openstack-System-Scope: None Sep 01 14:20:30.996343 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: User-Agent: python-urllib3/1.26.12 Sep 01 14:20:30.996343 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Auth-Token: gAAAAABjEL3NOrxJYijbJSOMZMLZzZSVPHyAdl_Bm2Q9EKvB6aWvFJhgq4XisE3tQ1CJ0eLS1f3ZaMz1-2KlOZ5qeLsAV5fmAZJmiV4-9A-IotFZOfK4CGwgPA9xha4GJ_b5LDPIkmmB5fUTtMCqvypE0Q1RYsFekKspBEpjT9EUqbzEyw-7SOw Sep 01 14:20:30.996343 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Id: None Sep 01 14:20:30.996343 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Name: None Sep 01 14:20:30.996343 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Identity-Status: Confirmed Sep 01 14:20:30.996343 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Is-Admin-Project: True Sep 01 14:20:30.996343 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Id: default Sep 01 14:20:30.996343 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Name: Default Sep 01 14:20:30.996343 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Id: 8acdb976501045c0813d16f3d0ffd13d Sep 01 14:20:30.996343 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Name: tempest-TestVolumeBootPattern-657955642 Sep 01 14:20:30.996343 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Role: member,reader Sep 01 14:20:30.996343 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Roles: member,reader Sep 01 14:20:30.998988 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8acdb976501045c0813d16f3d0ffd13d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8acdb976501045c0813d16f3d0ffd13d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8acdb976501045c0813d16f3d0ffd13d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8acdb976501045c0813d16f3d0ffd13d"}]}] Sep 01 14:20:30.998988 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant: tempest-TestVolumeBootPattern-657955642 Sep 01 14:20:30.998988 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Id: 8acdb976501045c0813d16f3d0ffd13d Sep 01 14:20:30.998988 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Name: tempest-TestVolumeBootPattern-657955642 Sep 01 14:20:30.998988 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User: tempest-TestVolumeBootPattern-657955642-project Sep 01 14:20:30.998988 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Id: default Sep 01 14:20:30.998988 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Name: Default Sep 01 14:20:30.998988 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Id: 93f843d15d194f0b9f44ec33c49b9b4c Sep 01 14:20:30.998988 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Name: tempest-TestVolumeBootPattern-657955642-project Sep 01 14:20:30.998988 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: method: > Sep 01 14:20:30.998988 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: exception: Instance da103289-634e-420f-9750-b36e4d00c641 could not be found. Sep 01 14:20:30.998988 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: action_args: {'id': 'da103289-634e-420f-9750-b36e4d00c641'} Sep 01 14:20:30.999991 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:20:30.999991 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:20:30.999991 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:20:30.999991 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:20:30.999991 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:20:30.999991 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:20:30.999991 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:20:30.999991 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:20:30.999991 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:20:30.999991 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:20:30.999991 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da103289-634e-420f-9750-b36e4d00c641 could not be found. Sep 01 14:20:30.999991 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:20:30.999991 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:20:30.999991 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:20:30.999991 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:20:30.999991 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:20:30.999991 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:20:30.999991 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:20:30.999991 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:20:30.999991 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:20:31.001559 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:20:31.001559 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:20:31.001559 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:20:31.001559 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:20:31.001559 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:20:31.001559 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:20:31.001559 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:20:31.001559 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da103289-634e-420f-9750-b36e4d00c641 could not be found. Sep 01 14:20:31.001559 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:20:31.001559 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:20:31.001559 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:20:31.001559 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:20:31.001559 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:20:31.001559 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:20:31.001559 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:20:31.001559 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:20:31.001559 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da103289-634e-420f-9750-b36e4d00c641 could not be found. Sep 01 14:20:31.001559 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:20:31.003204 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-fe98cc95-590e-4117-bd70-c1c4d784d51d tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Returning 404 to user: Instance da103289-634e-420f-9750-b36e4d00c641 could not be found. {{(pid=121339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:20:31.003204 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-fe98cc95-590e-4117-bd70-c1c4d784d51d tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/da103289-634e-420f-9750-b36e4d00c641" status: 404 len: 111 microversion: 2.1 time: 0.054352 Sep 01 14:20:31.003204 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 607/1217] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:20:30 2022] GET /compute/v2.1/servers/da103289-634e-420f-9750-b36e4d00c641 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 14:20:31.655832 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-b926320d-d9ed-4f2a-afc5-6031f5ae7032 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:20:31.656465 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.compute.api [None req-b926320d-d9ed-4f2a-afc5-6031f5ae7032 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: e221a685-4333-48cb-ab94-67a4c0402490] Fetching instance by UUID {{(pid=121340) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:20:31.663379 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b926320d-d9ed-4f2a-afc5-6031f5ae7032 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:20:31.663892 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b926320d-d9ed-4f2a-afc5-6031f5ae7032 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:20:31.664308 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b926320d-d9ed-4f2a-afc5-6031f5ae7032 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:20:31.665027 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b926320d-d9ed-4f2a-afc5-6031f5ae7032 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:20:31.665495 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b926320d-d9ed-4f2a-afc5-6031f5ae7032 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:20:31.665953 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG oslo_concurrency.lockutils [None req-b926320d-d9ed-4f2a-afc5-6031f5ae7032 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:20:31.682963 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.wsgi [None req-b926320d-d9ed-4f2a-afc5-6031f5ae7032 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] HTTP exception thrown: Instance e221a685-4333-48cb-ab94-67a4c0402490 could not be found. Sep 01 14:20:31.684684 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-b926320d-d9ed-4f2a-afc5-6031f5ae7032 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Request method failure captured: Sep 01 14:20:31.684684 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: request: DELETE /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490 HTTP/1.1 Sep 01 14:20:31.684684 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept: application/json Sep 01 14:20:31.684684 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Accept-Encoding: identity Sep 01 14:20:31.684684 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Connection: close Sep 01 14:20:31.684684 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Length: 0 Sep 01 14:20:31.684684 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Content-Type: application/json Sep 01 14:20:31.684684 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Host: 10.222.0.25 Sep 01 14:20:31.684684 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: Openstack-System-Scope: None Sep 01 14:20:31.684684 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: User-Agent: python-urllib3/1.26.12 Sep 01 14:20:31.684684 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Auth-Token: gAAAAABjEL3NOrxJYijbJSOMZMLZzZSVPHyAdl_Bm2Q9EKvB6aWvFJhgq4XisE3tQ1CJ0eLS1f3ZaMz1-2KlOZ5qeLsAV5fmAZJmiV4-9A-IotFZOfK4CGwgPA9xha4GJ_b5LDPIkmmB5fUTtMCqvypE0Q1RYsFekKspBEpjT9EUqbzEyw-7SOw Sep 01 14:20:31.684684 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Id: None Sep 01 14:20:31.684684 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Domain-Name: None Sep 01 14:20:31.684684 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Identity-Status: Confirmed Sep 01 14:20:31.684684 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Is-Admin-Project: True Sep 01 14:20:31.684684 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Id: default Sep 01 14:20:31.684684 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Domain-Name: Default Sep 01 14:20:31.684684 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Id: 8acdb976501045c0813d16f3d0ffd13d Sep 01 14:20:31.684684 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Project-Name: tempest-TestVolumeBootPattern-657955642 Sep 01 14:20:31.684684 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Role: member,reader Sep 01 14:20:31.684684 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Roles: member,reader Sep 01 14:20:31.687313 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8acdb976501045c0813d16f3d0ffd13d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8acdb976501045c0813d16f3d0ffd13d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8acdb976501045c0813d16f3d0ffd13d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8acdb976501045c0813d16f3d0ffd13d"}]}] Sep 01 14:20:31.687313 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant: tempest-TestVolumeBootPattern-657955642 Sep 01 14:20:31.687313 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Id: 8acdb976501045c0813d16f3d0ffd13d Sep 01 14:20:31.687313 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-Tenant-Name: tempest-TestVolumeBootPattern-657955642 Sep 01 14:20:31.687313 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User: tempest-TestVolumeBootPattern-657955642-project Sep 01 14:20:31.687313 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Id: default Sep 01 14:20:31.687313 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Domain-Name: Default Sep 01 14:20:31.687313 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Id: 93f843d15d194f0b9f44ec33c49b9b4c Sep 01 14:20:31.687313 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: X-User-Name: tempest-TestVolumeBootPattern-657955642-project Sep 01 14:20:31.687313 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: method: > Sep 01 14:20:31.687313 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: exception: Instance e221a685-4333-48cb-ab94-67a4c0402490 could not be found. Sep 01 14:20:31.687313 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: action_args: {'id': 'e221a685-4333-48cb-ab94-67a4c0402490'} Sep 01 14:20:31.688805 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:20:31.688805 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:20:31.688805 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:20:31.688805 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:20:31.688805 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:20:31.688805 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:20:31.688805 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:20:31.688805 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:20:31.688805 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:20:31.688805 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:20:31.688805 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e221a685-4333-48cb-ab94-67a4c0402490 could not be found. Sep 01 14:20:31.688805 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:20:31.688805 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:20:31.688805 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:20:31.688805 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:20:31.688805 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:20:31.688805 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:20:31.688805 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:20:31.688805 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:20:31.688805 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:20:31.691231 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:20:31.691231 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 14:20:31.691231 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 14:20:31.691231 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 14:20:31.691231 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 14:20:31.691231 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:20:31.691231 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:20:31.691231 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:20:31.691231 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:20:31.691231 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e221a685-4333-48cb-ab94-67a4c0402490 could not be found. Sep 01 14:20:31.691231 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:20:31.691231 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:20:31.691231 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:20:31.691231 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:20:31.691231 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:20:31.691231 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:20:31.691231 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:20:31.691231 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:20:31.691231 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e221a685-4333-48cb-ab94-67a4c0402490 could not be found. Sep 01 14:20:31.691231 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: ERROR nova.api.openstack.wsgi Sep 01 14:20:31.693581 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-b926320d-d9ed-4f2a-afc5-6031f5ae7032 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Returning 404 to user: Instance e221a685-4333-48cb-ab94-67a4c0402490 could not be found. {{(pid=121340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:20:31.693581 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-b926320d-d9ed-4f2a-afc5-6031f5ae7032 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490" status: 404 len: 111 microversion: 2.1 time: 0.037088 Sep 01 14:20:31.693581 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 611/1218] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 14:20:31 2022] DELETE /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:20:31.696568 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-0b88875f-8f24-4d66-a9bd-a9724eae4078 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '>' {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:20:31.697190 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.compute.api [None req-0b88875f-8f24-4d66-a9bd-a9724eae4078 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] [instance: e221a685-4333-48cb-ab94-67a4c0402490] Fetching instance by UUID {{(pid=121339) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:20:31.704427 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0b88875f-8f24-4d66-a9bd-a9724eae4078 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:20:31.704914 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0b88875f-8f24-4d66-a9bd-a9724eae4078 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:20:31.705352 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0b88875f-8f24-4d66-a9bd-a9724eae4078 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:20:31.706110 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0b88875f-8f24-4d66-a9bd-a9724eae4078 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Acquiring lock "f6df5693-3372-4a09-b232-632b81efd5be" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:20:31.706563 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0b88875f-8f24-4d66-a9bd-a9724eae4078 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:20:31.706985 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG oslo_concurrency.lockutils [None req-0b88875f-8f24-4d66-a9bd-a9724eae4078 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Lock "f6df5693-3372-4a09-b232-632b81efd5be" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:20:31.723102 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.wsgi [None req-0b88875f-8f24-4d66-a9bd-a9724eae4078 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] HTTP exception thrown: Instance e221a685-4333-48cb-ab94-67a4c0402490 could not be found. Sep 01 14:20:31.724663 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-0b88875f-8f24-4d66-a9bd-a9724eae4078 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Request method failure captured: Sep 01 14:20:31.724663 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: request: GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490 HTTP/1.1 Sep 01 14:20:31.724663 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept: application/json Sep 01 14:20:31.724663 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Accept-Encoding: identity Sep 01 14:20:31.724663 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Connection: close Sep 01 14:20:31.724663 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Length: 0 Sep 01 14:20:31.724663 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Content-Type: application/json Sep 01 14:20:31.724663 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Host: 10.222.0.25 Sep 01 14:20:31.724663 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: Openstack-System-Scope: None Sep 01 14:20:31.724663 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: User-Agent: python-urllib3/1.26.12 Sep 01 14:20:31.724663 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Auth-Token: gAAAAABjEL3NOrxJYijbJSOMZMLZzZSVPHyAdl_Bm2Q9EKvB6aWvFJhgq4XisE3tQ1CJ0eLS1f3ZaMz1-2KlOZ5qeLsAV5fmAZJmiV4-9A-IotFZOfK4CGwgPA9xha4GJ_b5LDPIkmmB5fUTtMCqvypE0Q1RYsFekKspBEpjT9EUqbzEyw-7SOw Sep 01 14:20:31.724663 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Id: None Sep 01 14:20:31.724663 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Domain-Name: None Sep 01 14:20:31.724663 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Identity-Status: Confirmed Sep 01 14:20:31.724663 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Is-Admin-Project: True Sep 01 14:20:31.724663 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Id: default Sep 01 14:20:31.724663 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Domain-Name: Default Sep 01 14:20:31.724663 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Id: 8acdb976501045c0813d16f3d0ffd13d Sep 01 14:20:31.724663 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Project-Name: tempest-TestVolumeBootPattern-657955642 Sep 01 14:20:31.724663 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Role: member,reader Sep 01 14:20:31.724663 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Roles: member,reader Sep 01 14:20:31.727304 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8acdb976501045c0813d16f3d0ffd13d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/8acdb976501045c0813d16f3d0ffd13d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/8acdb976501045c0813d16f3d0ffd13d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_8acdb976501045c0813d16f3d0ffd13d"}]}] Sep 01 14:20:31.727304 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant: tempest-TestVolumeBootPattern-657955642 Sep 01 14:20:31.727304 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Id: 8acdb976501045c0813d16f3d0ffd13d Sep 01 14:20:31.727304 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-Tenant-Name: tempest-TestVolumeBootPattern-657955642 Sep 01 14:20:31.727304 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User: tempest-TestVolumeBootPattern-657955642-project Sep 01 14:20:31.727304 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Id: default Sep 01 14:20:31.727304 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Domain-Name: Default Sep 01 14:20:31.727304 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Id: 93f843d15d194f0b9f44ec33c49b9b4c Sep 01 14:20:31.727304 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: X-User-Name: tempest-TestVolumeBootPattern-657955642-project Sep 01 14:20:31.727304 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: method: > Sep 01 14:20:31.727304 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: exception: Instance e221a685-4333-48cb-ab94-67a4c0402490 could not be found. Sep 01 14:20:31.727304 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: action_args: {'id': 'e221a685-4333-48cb-ab94-67a4c0402490'} Sep 01 14:20:31.728756 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: {{(pid=121339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:20:31.728756 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:20:31.728756 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:20:31.728756 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:20:31.728756 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:20:31.728756 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:20:31.728756 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:20:31.728756 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:20:31.728756 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:20:31.728756 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:20:31.728756 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e221a685-4333-48cb-ab94-67a4c0402490 could not be found. Sep 01 14:20:31.728756 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:20:31.728756 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:20:31.728756 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:20:31.728756 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:20:31.728756 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:20:31.728756 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:20:31.728756 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:20:31.728756 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:20:31.728756 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:20:31.731554 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:20:31.731554 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:20:31.731554 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:20:31.731554 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:20:31.731554 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:20:31.731554 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:20:31.731554 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:20:31.731554 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e221a685-4333-48cb-ab94-67a4c0402490 could not be found. Sep 01 14:20:31.731554 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:20:31.731554 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:20:31.731554 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:20:31.731554 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:20:31.731554 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:20:31.731554 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:20:31.731554 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:20:31.731554 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:20:31.731554 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e221a685-4333-48cb-ab94-67a4c0402490 could not be found. Sep 01 14:20:31.731554 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: ERROR nova.api.openstack.wsgi Sep 01 14:20:31.735320 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: DEBUG nova.api.openstack.wsgi [None req-0b88875f-8f24-4d66-a9bd-a9724eae4078 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Returning 404 to user: Instance e221a685-4333-48cb-ab94-67a4c0402490 could not be found. {{(pid=121339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:20:31.735320 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: INFO nova.api.openstack.requestlog [None req-0b88875f-8f24-4d66-a9bd-a9724eae4078 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490" status: 404 len: 111 microversion: 2.1 time: 0.033508 Sep 01 14:20:31.735320 dv-cinder-852211-7-iscsi devstack@n-api.service[121339]: [pid: 121339|app: 0|req: 608/1219] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 14:20:31 2022] GET /compute/v2.1/servers/e221a685-4333-48cb-ab94-67a4c0402490 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:20:33.405526 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: DEBUG nova.api.openstack.wsgi [None req-23e94f6d-e4bd-4136-a439-86dfcdc09ad1 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] Calling method '.version_select at 0x7f9867a93b80>' {{(pid=121340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:20:33.507459 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: INFO nova.api.openstack.requestlog [None req-23e94f6d-e4bd-4136-a439-86dfcdc09ad1 tempest-TestVolumeBootPattern-657955642 tempest-TestVolumeBootPattern-657955642-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1695617707" status: 202 len: 0 microversion: 2.1 time: 0.105958 Sep 01 14:20:33.508056 dv-cinder-852211-7-iscsi devstack@n-api.service[121340]: [pid: 121340|app: 0|req: 612/1220] 10.222.0.25 () {58 vars in 1263 bytes} [Thu Sep 1 14:20:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1695617707 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0)